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I.  Introduction 


t • I  Introduction 

Claooicol  signal  dotoction  and  sstiaation  involva 
csntralizod  signal  procsssing.  Traditional ly»  a  singls 
ssnsor  is  osploysd  for  obssrvations  and  tha  data  is 
procosssd  at  a  csntral  procossor.  Hors  rscantly* 
survsil lanes  systsss  ars  ssploying  sul tipis  ssnsors  for 
obssrvations  to  isprovs  systss  psrforsancs  parasstsrs  such 
as  rsliability  and  spssdt  and  also  to  inersass  ths  covsrags 
and  ths  nusbsr  of  targsts  undsr  considsration.  If  thsrs  is 
no  constraint  on  cossunication  channsl  and  procossor 
bandMidthSf  cosplsts  obssrvations  may  bs  brought  to  a 
csntral  procossor  for  data  procsssing.  In  this  cass»  ths 
signal  procsssing  is  still  csntral ixsd  in  naturo  as  shown  in 
Figuro  1.1.  Ths  thsory  of  csntralizod  signal  dstsetion  and 
ostimation  is  vory  wsll  undorstood  and  ths  solutions  to 
problsms  such  as  optimum  Bayssian  dstsetion*  Nsyman-Psarson 
dstsetion*  minimum  sguivocation  dstsetion  and  many 
ostimation  problsms  ars  availabls  in  standard  toxtbooks  Ill. 

Ths  goal  in  this  rsport  is  to  considor  soms  signal 
dstsetion  and  paramstor  ostimation  problsms  whsn  ths  signal 
procossing  is  not  contralizsd  in  naturs.  Multipls  ssnsors 
which  may  bs  spatially  distributsd  or  locatsd  at  ons 


Figure  l.l  Distributed  Sensor  System  with  Central  Computation 


location  ara  aaployod  for  making  obaarvationa.  Tha  ^onaara 
hava  aignal  procaaaing  capabilitiaa  and  aoma  or  all  of  tha 
procaaaing  la  dona  at  tha  aanaor  itaalf.  Tharofore»  such 
systama  parfora  diatributad  computation  aa  oppoaad  to 
cantralizad  computation.  In  tha  fully  diatributad  aystam 
shown  in  Figura  l.S*  all  tha  signal  procaaaing  is  parformad 
at  tha  sansora  and  tha  infaranca  is  avai labia  locally.  In 
soma  othar  diatributad  aanaor  aystams*  whara  a  global 
infaranca  is  dasirad*  partial  raaulta  ara  transmittad  to  a 
data  fusion  cantor  whora  thay  ara  appropriataly  combinad  to 
yiold  tha  global  infaranca  as  shown  in  Figura  1.3.  Soma 
othar  diatributad  aanaor  natwork  topologiaa  which  involva 
hiorarchical  structuras  hava  also  baan  studiad  in  tha 
litoraturo  C61.  It  should  ba  pointad  out  that  thara  ara 
many  practical  raasons  for  daploying  multipla  aanaor 
aurvaillanca  ayatams  with  diatributad  computation.  Thasa 
includo  costf  raliability*  survivability  and  limitations  on 
communication  bandwidth.  As  pointad  out  praviouslyt  tha 
classical  approach  to  signal  dotaction  and  astimation  has 
daalt  with  cantralizad  problams  and  analytical  solutions  are 
readily  available.  Tha  classical  theory  needs  to  be 
extended  to  ba  able  to  solve  distributed  hypothasia  tasting 
and  astimation  problams.  Tha  goal  of  tha  work)  reported  in 
this  report)  is  to  consider  and  obtain  analytical  solutions 
to  several  distributed  detection  and  parameter  estimation 
problems.  In  tha  next  two  sections)  we  introduce  tha 


notation  and  terminology  and  sat  up  the  distributed 


A 


Figure  1.2  Distributed  Sensor  System  with  Local  Inference 


datvction  and  distributad  paramatar  aatimation  problams 


raappctivaly .  Wa  also  briafly  diacuaa 
litaratura  on  tha  aubjact. 


thf 


ralavant 


1 . S  Distributed  Hypothesis  Testing 


1.5.1  System Description  and  Terminology 


In  this  report*  we  shall  consider  two  cii-fferant 
distributad  hypothesis  tasting  configurations.  Tha  first 
one  is  tha  fully  distributed  system  shown  in  Figure  1.5.  In 
this  system*  all  tha  signal  processing  is  performed  at  tha 
sensors  and  tha  inference  is  generated  locally.  We  will 
refer  to  this  distributed  detection  configuration  as  the  DD 
prgblliffl  throughout  this  report.  In  the  second  system  of 
Figure  1.3*  partial  results  from  the  sensors  are  transmitted 
over  bandlimitad  channels  to  the  data  fusion  center  where 
they  are  combined  according  to  a  fusion  rule  to  yield  the 
global  inference.  This  distributad  detection  with  fusion 
configuration  will  be  referred  to  as  the  PDF  .problem 
throughout  this  report.  It  should  be  pointed  out  that  the 
DDF  problem  can  be  reduced  to  the  DD  problem  by  a  suitable 
choice  of  the  fusion  rule  and  cost  functions. 


In  Figure  1.4*  we  present  the  basic  block  diagram  of  a 
distributed  detection  system.  This  block  diagram  includes 
both  the  DD  problem  and  the  DDF  problem.  The  basic 


•  *> 


I 


Figure  1.4  Distributed  Sensor  System  with  Data  Fusion 


componantB  of  tho  problM  oro  mm  followsi 

1.  A  oourco  ithich  gonoratM  an  output.  The  output 
could  bo  ono  of  n  pooolblo  cholcos.  Thoso  choicoo  aro 
roforrod  to  ao  hypothoooo*  and  aro  donotod  by 
HotHi » . . . thU-i .  Tho  a  priori  probabilitios  of  tho 
hypothooos  aro  donotod  by  J  ■ 

8.  A  probabilistic  transition  mochaniso  that  can  bo 
vioMod  as  a  mochaniso  *«hich»  basod  on  tho  knowlodgo  of  tho 
truo  hypothosis  and  somo  probabilistic  law*  choosos  a  point 
in  an  obsorvation  spaco. 

3.  An  obsorvation  spaco*  consisting  of  points  in  an 
n  x  N  difflonsional  spaco.  Each  point  is  roprosontod  by  an 
obssrvation  voctor  Y.* 

Y  -  . . 

whoro  y*  is  tho  obsorvation  vector  at  tho  dotoctor  i* 
i  •  1*8*...*N.  Each  y*  in  turn  is  givon  by 

y**  <  y»  1  *y*B* . . .  *y*T.)'^  i  *  1*8*. ..*N 

whoro  n  is  tho  number  of  observations  at  each  dotoctor. 
Without  loss  of  general ity*  wo  have  assumod  that  tho  number 
of  observations  is  tho  samo  at  each  of  tho  detectors.  Tho 
obsorvation  voctor  has  a  known  nN-dimonsional  conditional 
donsity  function  p<Y|Hj)*  j  •  0*l*...*n-l. 


'i'l 


Si!!' 


ma 


4.  A  dscision  rul»»  u*  *  Qiyk)*  for  ooch  dotoctor  i» 


i  a  Aftor  obsorving  tho  outcoino  in  tho 


oboorvation  spaco*  oach  datactor  uaaa  thla  rula  to  guaaa  as 


to  ii«hlch  hypothaaia  la  praaant.  Each  daciaion  aakar  Mill 


aaaign  tha  pointa  in  ita  OMn  obaarvation  apaca  to  ona  of  tha 


hypothaaaa.  Tha  vactor  conaiating  of  tho  local  daciaiona 


Mill  bo  danotad  by  st  i.o.»  k  >  (u& »ua* . . . 


9.  A  data  fuaion  rula  u  ■  f(}c>  Mhich  ia  uaad  by  tha 


data  fuaion  cantor  to  doclara  aa  to  Mhich  hypothaaia  ia 


praaant  on  tho  baaia  of  tho  vactor  >1.  Nota  that  tha  data 


fuaion  rula  doaa  not  axiat  in  tho  DO  probli 


Tho  block  diagraa  and  tho  notation  introducad  abova 


Mill  ba  uaad  in  Chaptara  8t  3»  4  and  9  Mharo  mo  Mill  aolva 


aoaa  diatributad  dataction  problaao.  Nantf  mo  ravioM  aoaa 


of  tha  roportod  Mork  on  diatributad  datoctioni 


1.2.2  Pravioua  Work 


8oaa  rocont  Mork  on  tho  dataction  probloa  Mith  aultipla 


inaora  haa  boon  raportad  in  tha  litaratura  (a.g.C  3-183) 


Tannay  and  Sandal  1  C33  axtandod  tho  claaaical  Bayaaian 


daciaion  thaory  to  tho  caao  Mharo  thay  conaidarad  tho  DD 


probloa  .  Thia  OMtonaion  doaa  not  folloM  froa  tha  claaaical 


thaory  in  a  atraightforaard  aannar  bacauaa  tha  daciaion 


ruloa  at  tho  individual  datactora  ara  coup lad.  Sadjadi  C43» 


troatad  tha  probloa  of  optiaua  dataction  Mith  N 


dacantralizod  aanaora  aalacting  aaong  n  poaaibla  hypothaaaa » 


•I/  V'  ^j-rr 


with  no  data  fusion.  Furthar  work  along  thasa  linas  has 
baan  parforaad  ,in  C5»63.  Lauar  and  Sandal  1  C93»  considarad 
tha  Bayasian  dataction  of  signal  wavaforas  in  tha  prasanca 
of  noisa.  Ekchian  and  Tannay  C6]»  formulatad  tha  dataction 
problam  for  various  distributad  sansor  natwork  topologias. 
Kushnar  and  Pacut  C7]  conductad  a  simulation  study  of  a 
spacific  distributad  dataction  problam.  Tanakatzis  C8«91 
has  also  solvad  soma  intarasting  dacantral izad  dataction 
problamsp  namaly  a  varsion  of  tha  Wald  problam  and  tha 
quickast  dataction  problam.  Tsitsiklis  and  Athans  C10]» 
hava  considarad  tha  computational  comp laxity  of 
dacantral izad  dacision  problams.  Thair  rasults  point  to  tha 
inharant  computational  difficulty  of  tha  problam  and  suggast 
that  optimality  may  ba  an  alusiva  goal.  Conta*  D'Addioi 
Farina  and  Longo  Clllf  hava  considarad  tha  dasign  and 
parformanca  avaluation  of  optimum  and  suboptimum  multistatic 
radar  racaivars.  Thair  suboptimum  structura  is  a  spacial 
casa  of  tha  DDF  problam  that  wa  shall  ba  considaring  in  this 
raport.  Staarns  CIS!  considarad  diffarant  combining  schamas 
in  ordar  to  datarmina  as  to  which  achiavas  the  bast  possibla 
racaivar  oparating  charactar istic  (ROC).  Soma  ralatad  work 
which  has  baan  raportad  from  a  control  standpoint  has  baan 
raportad.  Sandal 1  and  Athans  ClSlp  and  Radnar  C141p 
considarad  tha  dacantral izad  static  linaar  quadratic 
Guassian  (LOG)  problam  and  darivad  appropriata  dacision 
rulas.  Othar  information  structural  problams  wars  studiad 
by  Ho  CIS* 16* 171.  Sandal 1*  Varaiya*  Athans  and  Safanov 
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C183»  hav«  Hurvayvd  tha  dacantral iz»d  control  mothods  for 

largo  acala  ayatama. 

In  tha  naxt  aactiont  wa  introduca  tha  notation  and 
tarninology  for  tha  diatributad  paraaatar  aatimation 
problaa.  Wa  alao  diacuaa  tha  ralavant  litaratura  on  tha 
aub jact . 

1.3  Diatributad  Paramatar  Eatiaation 
1.3.1  System  Dascriotion _ and  Terminology 

A  data! lad  block  diagram  of  a  diatributad  paramatar 
aatimation  ayatam  with  fuaion  rula  ia  ahown  in  Figura  1.9. 
Local  paramatar  aatimataa  ara  obtained  at  tha  individual 
aanaora  and  ara  tranamittad  to  tha  fuaion  cantar  whara  thay 
ara  combinad  to  yiald  tha  global  aatimata.  Wa  will  rafar  to 
thia  diatributad  paramatar  aatimation  with  fuaion  atructura 
aa  tha  DPEF  problem.  The  basic  components  of  the  problem 
are  as  follows 

1.  A  parameter  apace^  consisting  of  points  which 
correspond  to  the  random  parameter*  a*  to  be  estimated.  For 
the  single  parameter  case*  it  corresponds  to  segments  of  the 
line  -•  <  a  <-•■•.  Tha  probability  density  function  of  the 
random  parameter*  a*  ia  denoted  by  p(a). 

S.  A  probabilistic  transformation  which  maps  the 
paramatara  to  an  observation  space. 

1 1 


Porometer 

Spoce 


Central  Estimate  Combiner 


Figure  1.5  Distributed  Estimation  System  with  Estimate  Comblnlnp 


3.  An  obMrvation  spaca  conalating  of  points  In  an 
n  X  N  dlMnoional  spaca.  Each  point  la  raprasantod  by  tha 
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obaarvatlon  vactor*  >(_,  ixhich  la 


Y  “  •  •  •  tyM"’’) 


Mhara  y^  id  tha  obaarvatlon  vactor  at  tha  aotiaator  1.  Each 
yi*  in  turn  is  givan  by  y»*  <yii»  vyk**  •  >  >  »yin>'^t  Mhara  n 
la  tha  nuabar  of  oboarvatlons  col lac tod  by  aach  aotiaator. 
Without  loss  of  ganorality*  mo  hava  aaauaad  that  tha  nuabar 
of  obsarvationa  is  tha  saaa  at  aach  of  tha  astioatoro. 


Tha  obaarvatlon  vactor  has  a  knoan  conditional  dansity 
function 


p(Y|a)  >  p(yt  »y«» . . .  »yr^|a) 


4.  An  aatiaation  rula  Sk  •  hk<yk>  at  aach  aotiaator  1* 
i  "  Each  aotiaator  usaa  Its  oan  aatiaation  rula 
to  aap  its  obaarvatlon  to  an  aatiaato.  Wa  Mill  aaauaa 
that  ostlmator  1»  1  ■  IkSf.Np  doas  not  hava  knoalodga  of 
tha  obaarvationo  at  othar  astlaatora  ^  ^  *  l»2f...tN. 
Tha  vactor  consisting  of  tha  local  astlaatao  Mill  bo 
danotad  by 


h  ■  ihk  (yi )  fha(ya) « •  • » khk«iyM)  i  • 

S.  A  coabinlng  rula  t  •  f«<h>  *  f«(lk vIm* • • • »Sm> 

Mhichp  baaod  on  tha  valuao  tk »  !«§...»  and  Im*  givas  tha 

global  astlmata  of  tha  paraaator  a. 
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Th«  block  diogrM  shown  in  Fig.  1.9  snd  ths  notation 
introducod  in  this  subssction  will  bo  ussd  in  Chaptsr  h 


whsrs  ws  will  solvo  soms  distributsd  parasstor  sstisation 
problMS.  Nsxtt  ws  brisfly  rsvisw  sows  rsportad  work  on 
distributsd  sstisation. 

1.3.2  Pc.gyiPVIJI  Work 

float  of  ths  work  rsportsd  in  ths  litsraturs  has  dsalt 
with  dscsntral izsd  stats  sstisation  problsss.  Borkar  and 
Varaiya  C191»  considsrod  asysptotic  agrssssnt  in  distributsd 
sstisation  problsss.  In  thsir  cass*  sach  of  ssvsral  agsnts 
updatss  its  sstisats  and  transsits  it  to  a  randosly  chossn 
sst  of  ths  othsr  agsnts.  Thsy  showsd  that  ths  cosson  lisit 
which  ring  sssbsrs  agros  upon  dspsnd  upon  ths  ordsr  in  which 
sstisatss  ars  transsittsd.  Tsnskstzis  and  Varaiya  CBOli 
studisd  ths  conssnsus  problss  in  distributsd  sstisation  with 
inconsistont  bslisfs.  Thsy  considorsd  ths  cass  whan  two 
psopls’s  sstisatss  of  ths  sasa  randos  variabls  ars 
availabls*  and  discusssd  convsrganca  of  ths  sstisatss  to  ths 
sass  valus.  In  C213»  Chang  and  Tabaczynski  considsrod 
sultissnsor  stats  sstisation  with  applications  to  ths  targot 
tracking  problss.  Millsky*  Bollo>  Castanon*  Lsvy  and 
Vorghsss  C223*  considsrod  cosbining  and  updating  local 


sstisatss  and  rsgional  saps.  Ths  sstisatss  say  bs  gansratsd 
at  diffsront  locations  or  at  difforsnt  tisss.  Thsy 
ssphasizsd  ths  concoptual  sisilarity  botwssn  sany  problsss 


in  dscsntral izsd  control  and  in  ths  analysis  of  randos 


fialda.  In  C833*  thay  davalopad  a  framaHork  for  tha  study 
of  cantralizad  astiaation  problaaa  whara  tha  dacantral izad 
astimation  problaa  is  imbadad  into  an  aquivalant  scattaring 
problaa.  In  CS4]t  thay  darivad  algorithms  for  diffarant 
mapping  problams  in  a  unifiad  framawork.  Castanon  and 
Tanakatzis  CS93f  obtainad  a  distributad  procassing  algorithm 
which  racovars  axactly  tha  cantralizad  conditional 
distribution  whan  only  tha  sufficiant  statistics  ara 
communicatad .  Washburn  and  Tanakatzis  in  C863  analyzad  tha 
parformanca  for  hybrid  stata  astimation  problams.  Varshnay 
and  Varshnay  CS7]»  hava  considarad  racursiva  astimation  with 
uncartain  obsarvations  in  a  multisansor  anvironmant. 

In  tha  naxt  saction*  wa  prasant  tha  raport 

organization. 

1 . 4  Raport  Organization 

In  this  raport  wa  considar  soma  distributad  dataction 
problams  as  wall  as  distributad  astimation  of  random 
paramatars.  Optimal  dacision  rulas  and  fusion  rulas  ara 
darivad  for  tha  distributad  dataction  problams  considarad. 
Similarly*  for  tha  distributad  paramatar  astimation 
problams*  optimal  local  astimators  and  combining  rulas  ara 
obtainad . 

In  Chaptar  2*  wa  prasant  tha  distributad  Nayman-Paarson 
dataction  problam  whara  wa  dasign  an  optimum  dacision 

systam.  First*  whan  tha  fusion  rula  is  known*  tha  dacision 
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rules  st  ths  individual  datsetors  are  derived  so  as  to 
eininize  the  probability  of  eiee  (or  to  eaxieize  the 
probability  of  detection)  under  a  constraint  on  the 
probability  of  false  alarm.  NsKt*  whan  the  decision  rules 
at  the  individual  detectors  are  known*  we  derive  the  optimum 
fusion  rule  using  the  same  criterion.  We  also  discuss  the 
overall  solution  where  we  simultaneously  obtain  the  optimum 
fusion  and  decision  rules. 


In  Chapter  3*  we  treat  the  problem  of  distributed 
Bayesian  detection  with  data  fusion.  The  optimum  decision 
rules  at  the  sensors  and*  the  optimum  fusion  rule  are 
derived.  Several  special  cases  such  as  the  independent 
observation  case  and  the  identical  detector  case  are 
discussed  in  detail. 


In  Chapter  4*  we  present  two  schemes  to  be  used  for 
distributed  postdetection  decision  making. 


In  Chapter  9*  we  solve  the  minimum  equivocation 
detection  problem  for  the  OD  and  the  DDF  systems.  Optimal 
decision  rules  at  the  individual  detectors  for  both  systems 
and*  optimal  data  fusion  rule  for  the  DDF  problem  are 


der i ved . 


Our  criterion  is  to  maximize  the  mutual 


information  (or  equivalently  to  minimize  the  equivocation) 
between  the  input  and  the  output. 


In  Chapter  6*  we  consider  the  distributed  parameter 
estimation  problem  when  multiple  estimators  are  used  and  a 
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combining  rulm  is  •mploymd  to  obtain  thm  global  matimata. 
Optimal  combining  and  oatimation  rulaa  ara  darivad. 

In  Chaptar  7»  aa  aummariza  tha  raaulta  and  alao  praaant 
aoma  auggaationa  for  futura  raaaarch. 


I 


II.  N«y«an-PMraon  D«t«ctlon  Using  nultipla  Sanaors 


2.1 


Tha  thaory  of  signal  dataction  using  a  singla  radar  is 
vary  t«all  undarstood  Clt23.  Tha  Bayasian  approach  to  tha 
optiaua  dataction  problaa  raquiras  tha  knowladga  of  tha  a 
priori  probabi 1 itias  and  tha  costs.  An  optiaua  dataction 
rula  is  than  obtainad  which  ainiaizas  tha  avaraga  cost  of 
dataction.  For  aost  radar  dataction  problaas»  tha  Bayasian 
approach  is  inappropriata  bacausa  tha  raquirad  inforaation* 
i.a.t  a  priori  probabilitias  and  costs*  aay  not  ba 
availabla.  For  this  raason*  tha  Nayaan-Paarson  critarion* 
which  doas  not  raquira  tha  abova  knowladga*  is  amployad 
axtansivaly  in  radar  dataction  systaas.  Undar  this 
critarion*  a  constraint  is  placad  on  tha  probability  of 
falsa  alara  and*  tha  probability  of  dataction  is  aaxiaizad 
(or  tha  probability  of  aiss  is  ainiaizad).  Tha  dataction 
rula  thus  obtainad  is  usad  for  signal  dataction. 

In  this  chaptar*  *«a  davalop  tha  Nayaan-Paarson  dacision 
thaory  for  signal  dataction  using  aultipla  radars.  Wa 
assuaa  tha  structura  shown  in  Figura  1.3*  i.a*  individual 
dacisions  froa  tha  radars  ara  fad  to  a  data  fusion  cantar 
which  yialds  tha  global  dacision.  A  constraint  on  tha 
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probability  of  falsa  alara  of  tho  ovarall  ayatoa  (global 
daciaion)  la  placad  and  tha  probability  of  mias  of  tho 
ovarall  ayataa  la  alnlalzad. 


In  Saction  S.2i  wa  foraulata  tha  problaa  and  dafina  tha 
notation  and  tarainology.  In  Saction  S.3»  wa  davalop  tha 
Nayaan-Paaraon  daciaion  thaory  whan  aultlpla  aanaora  ara 
uaad  for  aurvai 1 lanca.  Ua  conaidar  tha  problaa  of  binary 
hypothasis  tasting  using  aultipla  datactors.  First*  whan 
tha  fusion  rula  is  known*  daciaion  rulas  at  individual 
dotactora  ara  obtainad.  Thasa  rulas  ara  functions  of  tho 
data  fusion  achama  boing  aaployod  and  ara*  in  gonaral* 
couplad.  Sacondly*  whan  tho  daciaion  rulas  at  tha  datactors 
ara  givon*  tho  optifflua  fusion  rula  is  darlvad.  Tha  ovarall 
solution  to  tho  problaa  is  also  prasantad.  Spacial  casas  of 
"AND”  and  "OR"  data  fusion  rulas  ara  consldarad.  A  spacific 
axaaplo  is  prasantad  in  Saction  S.4.  Finally*  tho  rasults 
ara  discussad  in  Saction  2.9. 


2 . 2  Probl aa  Stataaant 


Ua  considar  a  binary  hypothasis  tasting  problaa  with 
tha  following  two  hypothosasi 


Ho  t  Targot  is  absant*  and 


Hi  I  Targat  is  prosant. 


(2-1 ) 


W«  considvr  th«  systMi  atructur*  shown  in  Figuro  1.3  whsro  s 
dots  fusion  csntor  is  usod  along  with  ths  distributsd 


Ths  obssrvations  st  ths  i***  dotsctor  sro  dsnotsd  by  » 
i"lpSp...»N.  Us  furthsr  sssuss  that  ths  joint  conditional 
probability  dsnsity  function  p(yt pysp . . . pyH|Hj) p  j*Oplp  is 
known.  Each  dstsctor  ssploys  a  docision  ruls  gi(yi>  to  maks 
a  local  dscision  ui  p  i«lp2p...pN  whsrs 

O  if  dstsctor  i  dscidss  Ho 

Up  «  (S-S> 

1  if  dstsctor  i  dscidss  Hi 

i  *  lpSp...pN 

Ths  data  fusion  csntsr  dstsnninos  ths  ovsrall  or  global 
dscision  for  ths  systssp  up  bassd  on  individual  dscisionsp 

1  .Sp  . 


U  *  f ( U 1 p Uap . . . p Um) . 

As  an  SKaspls  of  data  fusion  rulssp  ws  prsssnt  ths  "AND"  and 
"OR"  data  fusion  rulss  for  ths  spscial  cass  of  two  dstsctors 
(N*S)  in  Tabls  2.1.  Ths  global  dscision  u  is  simply  a 
Boolsan  AND  or  OR  of  ths  Boolsan  variablss  ui  and  ua.  Othsr 
data  fusion  rulss  involving  othsr  Boolsan  opsrations  on 
variablss  <Ui>p  can  bs  forsulatsdp  s.g.p  majority  logic. 
Latsr  in  this  chaptsr  wo  will  considsr  "AND"  and  "OR"  fusion 
rulss  as  sxasplos.  It  should  bs  pointsd  out  that  thsss 
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fusion  rulos  or*  not  nocosoarily  optiAuiR.  Tho  dorivation  of 
optiflHiNi  data  fusion  rulss  for  sultipls  sonsor  dstsction 
systoflis  is  also  considsrsd  in  this  chapter. 

The  goal  of  this  chapter  is  to  develop  the 
Neyean-Pearson  decision  theory  for  detection  systems  with 
multiple  sensors.  For  this*  mt  define  the  probability  of 
false  alarm  the  probability  of  miss  Pnt  and  the 
probability  of  detection  Po  of  the  overall  system 

PfT  -  Prob(u«l|Ho) 

P«  -  Prob(u-0|Hi)  (a-3) 

Pd  ■  Prob(u«l |Hi ) . 

The  probability  of  miss  and  the  probability  of  false  alarm 
for  individual  detectors  can  be  defined  in  a  similar  manner 
and  are  denoted  by  Pm^  and  P^»«  i>lta»...fNf  respect  ively. 

Tho  problems  are  considered  here.  In  the  first  onsp 
assuming  the  fusion  rule  is  kno»«n»  ee  find  the  decision 
rules  at  the  individual  detectors  which  minimize  the 
probability  of  miss  Pm*  under  the  constraint  that  the 
probability  of  false  alarm  satisfies  Pi^la.  In  the  second 
one*  when  the  decision  rules  of  the  detectors  are  given*  we 
derive  the  fusion  rule  to  satisfy  tho  same  condition  on  Pp- 
and  minimize  Pn.  In  the  next  section*  we  employ  the 
Lagrange  multiplier  method  for  the  solution  of  the  problems. 


S«3*l  Ootlmuii  D«ci»ton  Rui«« 


Um  considsr  th«  blnary'-hypothMls  N«yMn-P«arson 
dvtvction  problM  with  N  ••nsors.  In  this  subsactionf  w« 
first  aBBuiM  that  tha  obsarvations  at  tha  individual 
datactors  ara  statistically  indapandant  andt  that  tha 
conditional  probability  dansitias  p(y&|Hj>f  i*l»S»...»Nt 
J*0»lt  and  tha  fusion  rula  f (u& tUat . . . iUm)  ara  known.  Wa 
wish  to  aaKiaiza  Po  (or  aquivalantly  ainiaiza  Pn)  undar  tha 
constraint  that  P^  satisfias  tha  inaquality  Pwia, 
Following  tha  approach  takan  in  classical  NayaanH^aarson 
analysis!  wa  fora  tha  function 

r  •  P«  ♦  L  CP^  -  al  0-4) 
whara  L  is  tha  Lagranga  aultipliar. 

Wa  asBuaa  that  tha  fusion  rula  is  not  nacassarily 
datarainistic.  In  ordar  to  bo  abla  to  aKpross  Ppr  and  Pm  in 
toras  of  tha  probability  of  falsa  alara  and  tha  probability 
of  aisB  of  tha  individual  datactorsf  i.a.  Pm^'b  and  Pm^’B! 
wo  dofina  tha  following  quant itias 

8  ■  (ut  ftUi! . . .  fUM)*^!  a  voctor  whoso  alooants  taka 
valuas  zoro  or  onot  roprasanting  tha  dacisions  of  tha 
individual  datactors. 


3*; 


“  I  I  I  I  (  1  -  p«w  )  -  P  (X  I  Hx)|  (2-S-«> 

So  St 


Fk.  -  I  I  (I  -  P,rj)  I  I  P„^  -  P  <>1  I  Ho>l 
So  St 


P».»  ■  Prob(  u«k|  M> 


k  -  0,11 


So  >  s«t  of  all  j,  1  <  j  <N  and  >  0 


St  >  sat  of  all  k,  l<k<N  and  ui.  ■*  1 


Than,  wa  aay  axpraaa  Pn  and  Pw  as  follows 


Pr,  -  S  Po*  n« 


and. 


r  P»a  Fk 


(2-S-b) 


(2-S-c) 


(2-6-a) 


(2-6-b) 


(2-7) 


(2-B) 


Z  ■  Buaaation  ovar  all  possibla  vactors  x. 


Substituting  P^  and  P«  in  (2—4),  r  can  ba  axprassad  as 


r  -  Z  PoK  rix  L  <Z  P  tK  Fk  - 

n  M 


(2-9) 


i 


tjt'.i 

•'ll 


EKpandlng  (8*9 >  in  t«rM  of  and  P^nt  tho  probability  of 
Mias  and  tha  probability  of  falsa  alara  of  tha  datactor 
raspsctivaly  (  H  ■  liSfxN)*  r  bacoaas 


r  -  P«H  I  PoK  Mk  ♦  (I  -P«^)  Z  Po»  Mk 


♦  Ltd-  Z  P»«  F»  ♦  Z  PxM.  Pm.  -  «>  0-10) 


-  I  T  Pm4  I  I  <1  -  Pm-)  -  P<»»*|H, 


O-ll-a) 


Fk  -  II  <1  -  P^»>  T  I  ■  P<8**|Ho) 


(S-ll-b) 


H4 

Pxji  "Px*. 


X**  ■  <U 


1  f  U«  p  •  •  •  PUm  — S  pi 


■  p  •  •  •  pUm  ) 


i  -  Opl  O-ll-c) 


(S-lS-a) 


So  ■  So  Mhara  Uh  is  axcludad 


St  ■  Si  Mhara  Uh  is  axcludad. 


O-12-b) 


(2-12-c) 


jjii 


W 

i 


§ 


$ 


ji  vr*>'V" 


W«  than  h«v« 


n H  *  p«**  ^  L«*  cp^t<~4ii>] 


H  ■  lf2».».»N 


(2-18) 


MininlzAtlon  of  r>.  yloldo  tho  follOMing  llkolihood  ratio 


tdst  (LRT)  at  th«  H*''  datactor 


H, 

p(yH|Ht)  > 

Q^(yM)  - -  Lm 

p<yH|Ho)  < 


(2-19) 


^ara  tn  la  tha  solution  of 


Vh  -  I  p(Qm|H 


o)  dOt.  •  Oh 


1*2 . N  (2-20) 


Obsarva  that  tha  thrashold  of  tha  )**^  datactor  ia  a 


function  of  tha  fusion  rula  and  also  tha  probability  of 


falsa  alara  of  tha  othar  datactors  and  thusi  tha  othar 


thrasholds. 


Rapaating  this  procadura  for  all  tha  datactors*  wa  will 


gat  N  nonllnaar  aquations  in  N  unknoans.  A  siaultanaous 


solution  of  thasa  aquations  ylalds  tha  sat  of  thrasholds 


which  minlaiza  tha  probability  of  alas  of  tha  ovarall  systam 


undar  a  constraint  on  tha  probability  of  falsa  alarn  of  tha 


ovarall  systaa.  It  should  ba  notad  that  in  tha  spacial  casa 


tan  tha  ainiaal  solution  is  at  tha  and  point  of  tha 


Th«  two  LRT'o  ond  th»  corrooponding  oquatlono  for  tho 
throoholds  mrm 


Th«  two  LRT’b  and  tho  corrosponding  oquatlons  for  tho 


throcholds  for  tho  “OR**  fusion  rulo  oro 


Hi 

>  1  -  P.-! 

fli (yi )  L - 

<  P«i 

Ho 


(S-SS-a) 


p  (Qi|Ho)  dQi 


o  -  P^j 


(S-SS-b) 


1  -  P.-1 


2.3. 5  Optimum  Fusion  Rulo 


In  tho  provious  subsoction*  wo  dorivod  optimum  docision 


rulos  at  tho  individual  dotoctors  whon  tho  fusion  rulo  is 


initially  spocifiod.  Tho  optimiration  critorion  was  tho 


minimization  of  tho  ovorall  probability  of  miss  undor  a 


probability  of  falso  alarm  constraint.  In  this  subsoctioni 


wo  obtain  tho  optimum  fusion  rulo  whon  tho  individual 


dotoctors  (docision  rulos)  aro  spocifiodt  using  tho  samo 


optimization  critorion.  Ho  considor  tho  binary  hypothosis 


problom  as  statod  boforo. 


Wo  considor  tho  systom  structuro  of  Figuro  1.3.  Wo 


asBumo  that  tho  conditional  joint  probability  donsity 


function  p(yi  »y*tyat . . .  *yN|Hi)  f  j  <■  Ofl  is  known.  Each 


dotoctor  omploys  a  docision  rulo  gi(yi)  to  mako  a  local 


J 


’•.•la 


decision  u» »  l«l»S»...tNt  Mhsrs 


If  dstsetor  1  decides  Ho 


If  detector  1  decides  Hi 


(2-23) 


The  dots  fusion  center  determines  the  overall  or  global 
decision  for  the  system*  u*  based  on  Individual  decisions 
1  .e. » 


U  -  f (Ui.U.f . . . «Um) 


(2-24) 


Assume  that  the  decision  rules  for  the  Individual 
detectors  are  known.  As  before*  the  probability  of 
miss*  the  probability  of  detection  and*  the  probability  of 
false  alarm  of  the  overall  system  may  be  written  as 


Pm  •  Z  PoK  P»» 

X 


-  z  PtK  P| 


(2-2S-a) 


(2-2S-b) 


■  Z  P»ii  Pa< 


(2-2S-C) 


where 


Phjf  -  P(u»k|.j<> 


k  -  0*1 


(2-26-a) 


Pk*  -  P<>(|H,) 


j  -  0,1 


(2-26-b) 


••*  •/  •/  *.*  V'  s' 


As  baforv*  th«  function  to  b*  niniMlzod  io 


r  -  Pm  ♦  L  C  -o3  (S-S7) 

or  oquivolontlyf  tho  function  to  bo  ooKlolzod  lo 

F  •  Po  -  L  C  P^  -  «3  (S-S8) 

whoro  L  lo  tho  Logrongo  oultipllor.  Substituting  for  Pd  and 
In  <S-88)*  MO  got 

F  -  E  Pi*,  Pxi  -  L  CE  Pix  Pko  -«  3  (2-39) 

X  X 

NoMf  expanding  F  as  a  function  of  a  specific  value  of 
Kf  X*  *(ui*iUa*» . . . (Un*) »  MO  may  rewrite  (2-89)  as 

F  •  Pi*-  P«-i  -  L  C  PiK*  Pk*o  -  o-’3  K(?c->  (2-30) 


where 


’  *  a  —  E  Pijc  Pxo  (2— 31— a) 

K(x-)  -  E  Pix  P*i  (2-31-b) 

and* 

E  B  summation  over  all  possible  values  of  x  except  x- . 

Me  wish  to  maximize  F  by  varying  Pi*-  when  the  probability 
of  false  alarm  satisfies  Pi^  £  «.  This  problem  is  equivalent 
to  maximizing  Pi*-  P*-!  under  the  constraint  Pi*-  P*-o  io-’. 


.fj 


Dividing  0-30)  by  th«  constant  Pk*»  t  ws  hsvs 


F-  -  P»**  -  L-  C  P»**  -  a-  3  ♦  KMr-) 


(8-32) 


whoro 


F-  -  F  /  Pk«. 


L-  -  L  Pk-o  /  Pk“i 


o-  -  a-’/  Pa-o. 


(a-3a-«) 


(a-3a-b) 


(a-3a-c) 


KMx**)  -  K<k->  /  Pa*i 


(a-2a-d) 


K’(x*)  is  s  constant  in  P»a*.  Equation  O-aa)  rsprsssnts 
ths  aquation  of  a  straight  iina  in  Pm*.  Tha  maKiaum  is 
achiavad  by  satting  Pix*  as  folloMS 


Pia*  ■  *in 


(a-33-a> 


PlK*  -  O 


P»K*  ■  Bin  i  «•»!> 


ta-33-b) 


Pi*-  -  0 


^■»t:.«i:.»\:.«i:»«i:^n:.>tvt:i^««u«c.*i 


For  Mch  valu«  of  s*  »••  got  ono  oquotion.  Thoroforof  »•• 
hovo  o  total  of  aquations.  This  sot  of  aquations 
spaciflas  tha  optlaua  fusion  rulo  so  as  to  alniaiza  tho 
probability  of  aiss  undar  tha  probability  of  falsa  alarm 
constraint  Pf-  i  a. 


Non*  no  prasant  an  officiant  saarch  procodura  to 
laplooant  tha  abovo  rasult. 


1-  Coaputa  tha  quantitias  Pa*  /  Pxo  for  all  possiblo 
IS  of  s.  Arranga  thasa  quantitias  in  a  dacraasing 


ordar.  Danota  this  ordarad  saquanca  by  {4m>»  a  ■  1*2*...  *2*^ 
Nhora  0m  ■  Pg*!  /  P»i**o.  Daflna  a  saquanca  <am> 

corrasponding  to  Nhora  ■  Px”**  /  dm. 


2-  Sat  k  -  1. 


3-  Fora  tha  sua  Ik  ■  £  Om. 


4-  Coapara  |».  to  s. 


If  Ik  <  Of  sat  k  •  k  1  and  go  back  to  stop  3. 


9-  Sat  P*x*"  ■  1  for  all  a  i  k-1* 


PlX**  ■  Oh 


PiK*  ■  0  for  all  a  >  k 


'At.  4'-  4 


’i* 

I 


§ 

;•{ 


Hh«r« 


oil,  ■  (at  ~  Vk— t)  /Px**o» 


This  procsdurs  is  lllustrstsd  Mith  an  SNSNipls  in  ths  nsxt 
Bsction. 


Nowi  if  **#  SBBUM  that  ths  obsar vat  ions  at  ths 
individual  datsctors  ars  conditionally  indspsndsnty  ths 
solution  to  this  problsm  is  givsn  by 

Pig*  •  sin  <  «•»!> 

Mg*  > 

-  L  (2-34) 

Fx-  < 

Pin*  ■  O 

In  ths  nsxt  ssction  ws  prsssnt  two  sxasplss*  whsrs  ths 
cass  of  two  dstsctors  is  considsrsd.  In  ths  first  onst  Ws 
assuss  that  ths  fusion  ruls  is  known  and  ws  solvs  for  ths 
optisus  dscision  rulss  at  ths  two  dstsctors.  In  ths  sscond 
onst  ws  solvs  for  ths  bsst  fusion  ruls  whsn  ths  dstsctors 
havs  alrsady  bssn  dssignsd. 

2.4  gwPPlWl 
Exaspls  2.1 

Lst  us  assuss  that  ths  obssrvations  at  both  dstsctors  undsr 
ths  two  hypothssss  ars  sxponsntially  distributsd*  i.s.» 


nsxt 

ths 

ths 

■M 

y\ 


P<y» |Ko) 


IMP  <  -y  »  ) 


yt>0  1-1*5 


oth«rwiB« 


(S-39-a) 


p(y*!H»)  -  (1/0*)  SKpi-yk/O*)  y*iO  1-1*2 


<2-3S-b) 


otharMlBB 


mra  ths  signal  to  nolso  ratio  (SNR*>  1-1*2  la  glvan  by 


SNR*  -  0*  -  1 


1-1*2 


0*  >  1 

Wo  should  not#  that  ths  abovs  Is  an  approKlmats  modal  for 
Bovaral  radar  problams.  a.g.*  If  a  squara  law  anvalopa 
datactor  is  usad  for  narrowband  Gaussian  signal  and  nolsa* 
tha  output  follows  tha  aKponantlal  law  [28*  P.15-103.  Tha 
llkallhood  ratios  at  tha  datactors  ara  glvan  by 


fi*<y*>  - 


P(y*/Hi)  (1/0*)  axp(-y*/0,N) 


P(y*/Ho) 


iKp(-y*) 


-  (1/0*)  axpCy* (l-(l/0* ) )3  1-1*2  (2-36-a) 


Tha  LRT  Is 


(1/0*)  axp<y*(l  - 


Hi 

> 

(l/0*))>  t* 

< 

Ho 


38 


yiCl  -  (l/ei)3  ln(t»»k> 

< 

Ho 


<  0»  -  I 

Ho 


ln(ti9k)  ■■ 


i«ita. 


(8-36>b) 


i«r«  t*  can  b«  •icprasaad  ••  a  function  of  t’n  as 
tt  •  (i/Ok)  oKpct’id  -  (i/et))>  i-i»a 


(e-36-c) 


Tho  probability  of  falsa  alara  and  tho  probability  of  miss 
for  tha  two  datactors  ara  givan  by 


f  -y»  -t'» 

-  a  dy»  •  a 


r  e»  ,  (e»/(i-©»)) 

Mpj^  - - ln<©»  **  j  " 


1-1,2  (2-37-a> 


i 


‘‘•Vis!**.!'*.!**.!*' 


s 


I 


51 

n 

v*i 


'A 


j! 

‘<il 

'M 

».'P 


Pii»  ■  I  <l/Oi)  •xp{-y&/0k>  dy»  ■  1  -  •xpC“t'i/9»> 


■  l-«xp^  - - ln(Ok  " 


(l/(l-«») ) 


1  -  (Giti) 


i-i»a 


(2-37-b) 


From  (8*>17)t  thm  two  thrmsholdo  also  omtiofy  tho  following 
■•to  of  •quotions 


<*  ”  Kai 


- 


i>l»8 


(8-38) 


L.  1 


i-1,8 


(8-39) 


A  oimultanmou*  oolution  of  tho  obovo  oquotiono  yioldo  tho 
dosirod  throsholdo.  Tho  solution  roquiros  tho  knowlodgo  of 
tho  fusion  rulo.  Noxt»  wo  considor  tho  "OR”  ond  ’’AND" 


fUBi< 


iloo. 


"OR ”  fusion  rulo 


In  this  COSO* 


C^i  ■  1  1  -  oxp(-t'j) 


Cm  •  P«j  ■  1  —  Oxp(— t*j/8j) 


Km%.  ■  Pf-j  ■  Oxp(-t*j) 


1  f  J  i,J  -  1,8 


W«  Bubstitut*  thB  Bbov*  into  (8-36)*  ¥tm  got 


•  “  K«» 

P,ri  - -  1-1,2 


o  “  j 
1  - 


l.j-l,2 


( 2-40-b ) 


Also 


L  <1  -  Pp^j) 


ifj 


(2-40-b) 


Solving  (2-40’*b)  for  L  <for  1  -1,2)  and  oquating  tho  roaulta 
wo  got 


1  -  P.-.  1  -  P-, 

t. - -  t, - 

P««  Pmi 


(2-41 > 


Subotltutlng  for  t,,  P^^ ,  and  P,,,,  1-1,2  in  (2-41)  and 
(2-40-a>,  wo  got 


1  1  -  oxp(-t'.) 

--  OKpCt*«(l-<l/««>)3  - 

g*  1  -  oxp(-t’«/9«> 


1  1  -  oxp(-t*,> 

—  oxpCt’,(l-(l/g, )>3  -  (2-42-a) 

g,  1  -  oxp(-t’ i/e, ) 


’•ii 

■M 


‘•I 

'i»a 

'4 


**“ 


•'*1 


►xp<-t*  t  ) 


a  -  axpc-t  «) 


(a-42-b) 


1  -  •xp(-t'M) 


N«xtt  l»t  •xp(~t’i>  ■  Ai  And  •xpC-t'a)  ■  Aat  and  aubstitute 


in  (S-4a-a)  and  (S-4S-b)t  •••  Hava 


1  -  A. 


1  -  Ai 


(2-43) 


(l-l/O.) 

e.(A«  -  A.) 


(l-l/©») 

e>(Ai  -  At) 


«  -  At 


(2-44) 


1  -  A« 


As  a  numarical  axampla*  lat  0tB2t  €)s>B4t  and  a  «  .29  and 


Bolva  for  Aa. 


gat  tha  valua  of  Aa  that  corraaponds  to 


tha  optimum  aolution  auch  that 


A«  -  0.179 


and  I  tha  valua  of  At  la 


At  -  0.0909090 


Mhich  laad  to  tha  fol lowing  valuaa  of  t’l  and  t’l 


ft  -  1.742969 


t*.  -  2.3978993 


i 


Mith  •  valu*  of  Pn  -  0.S4671711 


Wa  ahoM  tho  ROC  for  thia 


problam  in  Figura  S.l.  Naxt»  tha  "AND"  caaa  ia  praaantad. 


In  thia  caaa  wa  hava  a  aituation  whara  tha  thraahold  ia  at 


ona  of  tho  and  pointa. 


"AND"  Fuaio n J5ulXj» 


In  thia  caaa*  wa  hava 


C.r^  -  a  axpC-t’^)  i^j  i*J-l,S  (5-AS-a) 

-  1  -  P«j  -  axp(-f^/©3)  i^j  i,j-l,S  (a-4S-b> 


From  <8-39) f  wa  hava 


Cm  tt  Ciia  ta 


<1  ”  Pna)  <1  —  Pmi) 


(8-46) 


P.'.  t. 


Pi»-i  t » 


Bubatituting  (8-36-c)  and  (8-49)  into  (8-46) f  wo  obtain 


ixp(-t’a/9a) 


»Xp<-t’ i/0i ) 


ixp(-t’.)  oxpCt'.(  l-l/ea)3  axp(-t’x)  axpCt'idl/ei)] 


(8-47) 


which  laada  to  tho  condition  9i*0a. 


Binca  in  ganaral i  9%  ^  0«»  wa  concluda  that  tha  ainiaum 


corraaponda  to  tha  and  pointa.  Bolving  thia  problaa  wa  find 


that  Pm  •  Prta  And*  Pf-  *  Pwm  from  whmrm  mm  can  aolva  for  tho 


valuo  of  t't  (and  t'«)  .  Wo  ahoM  tho  ROC  for  tho  caao  nhon 
Oi«S  and  in  Figuro  8.1. 

EXAMPLE  8.8 

Asaumo  that  tho  probabi 1 itioa  of  faiao  alarm  and  miaa 
of  tho  two  dotoctora  with  Indopondont  obaorvatlona»  which 
havo  alroady  boon  doaignod*  aro  givon  by 

P^  1  ■  0.3t  Pf’*  •  O.A*  Pm»  •  0.8  and*  Pmb  •  0.8S. 

Wo  wlah  to  find  tho  optimum  fuaion  rulo  which  mlnlmlzoa  tho 
probability  of  mlaa  of  tho  ovorall  ayatom  whan  tho  ayatom'a 
probability  of  falao  alarm  aatiafioa  Pf  i  0.81. 

For  thla  oxamplo*  ualng  Foo *  Fev*  F^o*  F^a.*  Mba*  Max* 
Mxa  and  Mx.i  (tho  quantltloa  doflnod  provloualy)*  tho 
ordorod  aoquonco  and  tho  corroaponding  x"*  aro  tabulatod 
aa  followa 


. 8  X  .79  0.6 

- - - - «  s,  .  (ii)T, 

.3  X  .A  0.18 

.8  X  .89  0.8 

0a  - - -  - -  1.111*  X“  ■  (lO)"^* 

.3  X  .6  0.18 

.8  X  .79  0.19 

4,  - - - - -  0.939*  X*  -  (01 1"^* 


d«riv»d.  Th«  dacislon  rul««  and  thalr  computation  at 
individual  datmctora  arm  couplad.  Ua  hava  conaidarad  tha 
apacial  caaaa  of  “AND"  and  "OR**  fusion  rulas.  Wa  hava  also 
prasantad  tMO  axamplas  for  illustration.  Whila  computing 
tha  dacision  rulasp  ona  may  obtain  multipla  solutions.  Only 
tha  faasibla  solutions  ara  to  ba  kapt.  Tha  optimum  fusion 
rula*  Mhan  tha  dacision  rulas  of  tha  individual  datactors 
ara  knownp  mas  also  darivad.  It  should  ba  pointad  out  that 
solving  aquations  <S-19)  and  (2-34)  simul tanaously «  in  tha 
casa  of  indapandunt  obsar vat  ions*  solvas  tha  problam  of 
finding  both*  tha  optimum  fusion  rula  and  tha  optimum 
dacision  rulas  at  tha  individual  datactors.  A  solution  of 
similar  aquations*  in  tha  casa  of  dapandant  obsarvations* 
yialds  tha  ovarall  solution  to  tha  problam  with  dapandant 


obsarvations 


III.  Distributad  fiayasian  Hypothaaia  Taating 


3.1  Introduction 

Bayaaian  hypothaaia  taating  problaa  for  cantralizad 
ayataaa  haa  baan  daalt  with  axtanaivaly  in  tha  litaratura 
Cl].  Givan  tha  a  priori  probabi 1 itiaa  and  conditional 
danaitiaa  of  tha  obaarvationa  for  aach  hypothaaia*  fixad 
coata  ara  aaaignad  to  aach  poaaibla  couraa  of  action.  Than* 
optimum  daciaion  rulaa  ara  darivad  ao  aa  to  minimiza  tha 
avaraga  coat.  Tha  raaulting  daciaion  rula  ia  a  likalihood 
ratio  taat. 

Thara  haa  baan  aoma  racant  affort  to  axtand  tha 
Bayaaian  hypothaaia  taating  formulation  to  tha  caaa  of 
diatributad  aanaora.  Tannay  and  Gandall  C33*  hava  aolvad 
tha  binary  DO  problam  for  tha  caaa  of  two  aanaora*  i.a.* 
thay  hava  traatad  tha  diatributad  dataction  problam  without 
a  fuaion  cantar.  Tha  coat  aaaignmant  may  raflact  tha  affact 
of  fuaion  but  tha  daaign  of  a  fuaion  rula  haa  not  baan 
conaidarad.  Tha  work  haa  baan  axtandad  by  Lauar  and  Gandall 
to  dataction  of  aignal  wavaforma  in  noiaa  in  CS3.  Thay  hava 
alao  briafly  conaidarad  aoma  mora  ganaral  aituationa  auch  aa 
tha  dapandant  obaarvationa  caaa.  Gadjadi  C4]*  axtandad 
Tannay  and  Gandall 'a  work*  C3]*  to  includa  multipla 
hypothaaaa  and  mora  than  two  aanaora  for  tha  DD  problam. 


Tha  contribution  of  tho  work  roportod  in  this  choptor  is  to 
prssont  s  gsnorslizsd  Bsyssisn  foraulstion  of  tho 


distributod  dotsction  problos.  Tho  foraulstii 


ly  bo  ussd 


to  obtain  solutions  to  both  tho  DD  probloo  ss  woll  ss  tho 
DDF  probloo.  Thus*  provious  work  bocooos  a  spocial  caso  of 
tho  work  roportod  horo.  In  addition*  wo  considor  sooo 


spocial  Cl 


of  indopondont  obsorvations 


and  idontical  dotoctors  in  dotail. 


In  Boction  3.S*  wo  foroulato  and  oolvo  tho  binary 
Bayosian  hypothosis  tooting  probloo  for  tho  DDF  systoo.  In 
Boction  3.3*  wo  OMtond  tho  study  to  tho  caso  of  n 
hypothooos.  In  Boction  3.4*  wo  prosont  sooo  spocial  casos. 
In  particular*  wo  prosont  tho  solution  for  tho  caso  of 
indopondont  obsorvations.  Bpocial  attontion  is  paid  to  tho 
caso  of  binary  hypothosis  and  idontical  dotoctors.  EKSoplos 
and  sooo  nuooricsl  rosults  aro  prosontod  in  Boction  3.5. 
Boction  3.4*  contains  -a  discussion  of  tho  rosults  obtainod 
in  this  chaptor. 


In  this  soction*  wo  considor  tho  binary  Bayosian 
hypothosis  tosting  probloo  whoro  wo  havo  two  hypothooos  H. 
and  H* .  Wo  considor  tho  systoo  shown  in  Figuro  1.3.  which 
is  also  roproducod  as  Figuro  3.1.  Each  dotoctor  i*  basod  on 


its  obsorvation  voctor  y*  ■■  (yi 


•  ykn)*^  oakoi 


mm. 


Phenomenon  H 


I2/  JTa 


DM  N 


UjJ  •  •  • 


Data  Fusion  Confer 


Figure  3.1  Oiscrlbuted  Sensor  System  with  Data  Fusion 


s 


i 

J 


i 


dsclBion  u»  f 


lt8»...fN.  Each  daciaion*  u^t  aay  taka 


tha  valua  0  or  1»  dapanding  on  Mhathar  tha  datactor  i 
dacidas  Ho  or  Ha. 


Tha  probability  of  falsa  alara  and  tha  probability  of 
dataction  of  datactor  i  ara  danotad  by  P^a  and  Poa 
raspactivaly.  Tha  ovarall  probability  of  falsa  alara  and 
tha  probability  of  dataction  ara  danotad  by  P^  and  Po 
raspactivaly.  Tha  global  dacision*  u»  is  aada*  knowing  tha 
dacision  vactor  containing  tha  individual  dacisions*  i.a.p 
X  <■  (ua  >u«t . . .  tUN)'^.  Wa  assuaa  that  tha  global  dacision. 
ut  dapands  only  on  tha  dacision  vactor  x.  and  doas  not 
dapand  on  tha  obsarvations  at  tha  individual  datactors. 


Tha  goal  of  this  saction  is  to  davalop  tha  thaory  of 
Bayasian  hypothasis  tasting  for  tha  DDF  systam.  i.a.»  dasign 
tha  optiaal  systaa  (obtain  both  tha  fusion  rula  and  tha 
dacision  rulas  at  tha  individual  dacision  aakars)  so  as  to 
ainiaiza  tha  avaraga  cost.  Tha  Bayas  risk  function  that 
wo  wish  to  ainiaiza  can  ba  writton  as 


1  1 

>  £  £  C.j  Pj  P.-(dacida  H.IH^  is  pri 

i>0  j-0 


(3-1) 


whoro  C.4  is  tha  cost  of  daciding  H.  whan  Hj  is  prosont  and 
Pj  is  tha  a  priori  probability  of  hypothasis  H^.  i.j  ■  0.1. 
Throughout  this  chaptar.  it  will  ba  assuaad  that  and  P^ 


'iV| 

pi 


‘JIF 


ivj 


I 


I 

I 


¥ 


I 

i 


Ar«  knovm.  U«  can  rsMrita  (3-1)  as 


Rm  "  Coo  Po  Pr(u"0|Ho  is  praaant) 


C»o  P«  Pr(UBl|Ho  la  praaant) 
Coa  Pa  Pr(u«0|Ha  ia  praaant) 
Cat  Pa  Pr<u»l|Ha  la  praaant ) i 


(3-8) 


R»  ■  PolCood  -  P^)  ♦  CaoPf'>  PalCoad  -  Po)  ♦  CiaPo) 

(3-3) 


Subatituting  l-Po  for  P,  and  raarranging  (3-3) »  aa  hava 
R*  ■  P^  <  Po(Cao  -  Coo)>  ♦  Po  Cd  -  Po)(Cia  -  Co»  >  > 


♦  Coad  -  Po)  CooPo 


(3-4) 


R»  “  Pp-  —  Co  Po  ♦  C 


(3-S) 


Nhara 


Cp  ■  Po  (  Cao  —Coo) 


Co  "*  (I  —  Po)(Coa  —  Caa) 


(3-6-a) 


( 3-6-b ) 


C  -  Coa  d  -  Po)  ♦  Coo  P< 


( 3-<.-C  ) 


Throughout  tho  diocuooioiit  •••  Mill  ossumo  that  aaklng  a 
Nrong  daciaion  la  aora  coatly  than  aaklng  a  corract  daclaion 


1  .a. » 


C ao  ^  Coo 

and,  (3-7) 

Cot  ^  Ct  t 

which  Imply  that  C^  >  0  and  Co  >  O.  Bafora  wa  continua,  wa 
naad  to  daflna  tha  following  two  aata  of  conditional 
probabllltiaa, 

P(KjH4)  ■  P ( u t t Uo • • • • f Um I H j )  ( 3— B— a ) 

which  la  tha  probability  of  daciding  ut  at  tha  firat 
datactor,  u«  at  tha  aacond  datactor * . . . ,  and  um  at  tha 
datactor  whan  Hj  ia  praaant,  j ,ut , uo, . . . ,um  *  0,1. 

P(ua>i|K)  •  P<U«i  |Ut  ,Uo,  .  .  .  ,Ui>4>  (3-B-b) 

which  ia  tha  probability  of  making  a  global  daclaion  i,  whan 
tha  individual  datactor  daciaiona  ara  u, ,uo, . . . ,um,  whara 
i  ,Ut  ,Uo,  .  .  •  ,Ur«  *  0,1. 

Thua,  tha  probability  of  falaa  alarm  can  ba  axpraaaad  aa 

P,-  -  E  P(u-l|x)  P(x|Ho)  (3-9) 
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•nd  th«  probability  of  dotoction  io 


Pd  >  £  P(U>1|K)  P()l|Hi> 


Bubotituting  (3-9)  and  (3-10)  into  (3-5) »  mo  hava 


(3-10) 


Rd  -  CfT  £  P(u-l|&)  P(k|H< 


-  Co  £  P<u-1|K)  P(s|Hi)  C 


<3-11 > 


Noxt*  •••  procoad  with  tha  solution  to  tha  DDF  problaa. 


3.2.8  Optiaua  Svataa 


First*  wa  aaauaa  that  tha  datactora  hava  baan  daaignad 
and  wa  obtain  tha  fusion  rula  which  ainimixas  R».  Tha 
rasult  is  prasantad  in  Thaoraa  3.1.  Than*  wa  assuma  that 
tha  fusion  rula  is  known  and  wo  dorivo  dacision  rulos  at  tha 
individual  datoctors  which  again  ainimiza  R*.  This  rasult 
is  prasantad  in  Thaoraa  3.2. 


Thaoraa  3.1 


Givon  tha  dacision  rulas  at  tha  Individual  datactors  * 
tha  following  fusion  rula  ainiaizos  tha  risk  function  for 
tha  binary  DDF  problaa 


P(u-1  U)-l 

P(x|Hi)  >  Cp 


for  all  X 


(3-12) 


PCxIHo)  <  Cl 

P(u>l |x)-0 


•*» 


Th«  «inliHi«  risk*  !• 


-  C  -  £  C  Co  P(ii|Ht>  -  C..  P(n|Ho>] 


(3>13) 


Mh«r« 


(3-14) 


6  •  <  K  I  CCo  P(x|H,)  -  Cm  P(k|Ho>3  >0  > 


and  C»  Cd  and  Cm  ara  as  dafinad  bafora. 


gCflflf. 


Wa  ■■alias  that  tha  datactora  in  Figura  3.1  hava  alraady 
baan  dssignad»  i.a.f  for  a  givan  obaarvation  vactor 


1  •  (y»'*'f ya'^f . . .  f 


tha  docialon  vactor  a  ■  (ut  *u«» . . .  and  tha  conditional 
probabilitiy  danaitiaa  PCKjH^)*  j  >  0»1»  ara  known.  Lat 
S*  a  (u*t  . . .  »u*r4)'^  ba  ona  out  of  tha  2*^  poaaibla 
dacision  vactora.  Than*  Ra  froa  aquation  (3-11)  can  bo 

oMprasBod  aa 


Ra  -  P(u-l|x-)  CC,-  P(x*jHo)  -  Co  P(x»|H»)D  ♦  K(x-) 


(3-17) 


Mhora 


*iVI 

r> 

i. 

;%] 

■>: 

.I**4 

^•1 

',yi 


5*fc 

I 


K(n*)  -  £  P(U-1|M)  tCw  P(e|Ho>  -  Co  P(k|H»)3  *C 


0-18) 


(3-17)  is  ths  squstion  of  s  strsight  lino  in  PCuBljn**)  Mhsrs 
tho  slops  is  <C^  P(2(*|Ho)  -  Co  P(s*|Ho)>  sndt  K(k*)  is  s 
constsnt  in  P(u*1|k*).  Bines  »«s  hsvs  sssussd  thst  ths  costs 
CtA  srs  prssssignsd  and  ths  dstsetors  hsvs  slrssdy  bssn 
dssignsdf  ths  qusntitiss  C^»  P(x*|Ho)»  Co  and  P(x*|Hi)ars 
knoMn.  P(ub1|>(*)  is  a  probability*  and  it  takss  valuss  in 
CO* 13.  In  ordsr  to  sinisizs  Ro*  ms  sust  havs 


P(u»1(x-)  -  0 
P<u»l|8-)  ■  1 


if  ths  slops  is  positivs  andi 


if  ths  slops  is  nsgativs. 


C^  P(a*|Ho)  -  Co  P(a*|H,) 


P(u-1 I x-)-0 


P(u-1 1  *»•)-! 


(3-19) 


Using  ths  cost  assusption  givsn  in  (3-7)*  (3-19)  is 


squivalsnt  to 


P(u-1 |K*)«1 


Q()f)  - 


P(lt*|H,) 

P(K*|Ho) 


(3-SO-a) 


P(u-1  |i«*)-0 


‘^•*1 


Q(x*) 


(3-HO-b) 


<  Cl 

ubO 


Mhich  r»prM»nt«  th«  fusion  ruls  for  ony  docision  vsctor  &. 


Now*  *«•  obtain  tho  valua  of  tha  ainiaua  riaki 
Substituting  from  (3-SO)  into  <3~ll>t  tha  risk  function  can 
ba  Mr it tan  as 


RMMtik  n 


Z  <C»r  P(%|Ho) 
6 


2:  <Co  P(SL|Ht) 
6 


-  Co  P(x|Ha>> 


(3-ai-a) 


-  C^  P()i|Ho>> 


(3-2l-b> 


Mhara 


6  *  <  K  I  Q(|i)  >  C,r/Co  >. 

Wa  raaark  that  for  all  x  in  8  {CdP(k|Hi )-C^  P(s|Ho)>  is 


nonnagativa  and  tharafora*  Ro«kr.  S  C. 


Thaoraa  3.2 


Q.E.D. 


Sivan  tha  fuaion  rula  u  ■  f (ua tUof . . • »Um>  and  tha 
conditional  dansitias  p<ya »yo» . . . »yM|Ha ) »  j  ■  0»1»  tha 

dacision  rula  at  tha  P**'  datactort  H  ■  lt2»...»Np  Mhich 


ife' 

S'JS* 


•*’1 


MiniaiiZM  R»  is  givsn  by 


Uh*! 

> 


p(yM|H»>  £  [dX»*  A»**  P(2i*‘j5f»‘>  C»  p(X**  j y.. tH»  ) 

a**  J  < 

Uh*0 

p(yM|Ho>  I  dY-  Ah.**  P(a**|Y**>  Ct-  P  <5^**  |  »H.  ) 

a-  j 

X** 

(3>2S>«) 


Mh«r« 


Y**  ■  (yi‘'’»y«''^f . . .  »y>.-»‘'’»y»— •  •  •  »y»«*'^)'^» 


Ah**  ■  P<u*ljxM>  -  P(u“ljxH> 


( 3-22-b  > 


(3-22-c) 


( 111  f  Uat  t  •  •  •  t  Uh*  j  f  •  •  •  » U»<*  )  ^  < 


( 3-22-d ) 


Proof 


Wo  con  oxpond  Rb  givon  in  (3-11)  in  torms  of  Um >  tho 
docioion  of  o  opoclflc  dotoctor  H»  H  ■  1»2»...»N.  Wo  thon 

hovo 


RbbC-^  £...£  <  (P(U«1  |Ua  »  .  .  »U».*1  t  •  •  >Un>  X 
U  s  ■  •  ■  Ufa 

oxcopt  Uh 

CCb^P  (  Ua  p  •  •  p  llp«  •!  P  •  •  p  Um  I  Ho  )  —  CoP  (lJapa«pUH*lf*«»  Oisi  |  H  a  )  3 
••■(P<U*1  |Ua  p  .  •  pUh*Op  .  .  pUm)  X 

CCbP  (  Ua  p  •  ■  p  Uh*0  p  •  •  p  Urp  |  Ho  )  CoP  (  U  a  p  •  ■  p  11h*0  pB*piiM|Ha)3)3 


( 3-23 ) 


'•’i 

I 

I 


For  nototionol  convonioncot  wo  dofino  tho  following 


Km  •  (UiVaaaV  tii*  *  J  f  •  •  •  i  CIn  J*Opl  ^  3"*23"0  ) 

Uh"J 


K**  -  <Ui 


iUh  — »  f  U» 


( 3-23-b  > 


Z  ■  ouiMiiotion  ovor  oil  poosiblo  voluoo  of  Ui  such 


that  i  ^  H< 


Thon»  (3-23)  bocomos 


(3-23-c) 


R»  -  C  4-  £C  P<u«1|Xm)  CO  P(xh|Ho>  -  Co  P(Xh|H»)3 
»** 


*  P(u-1|xm)  CO  P(Xh|Ho)  -  Co  P(Xh|H,)3> 

( 3-24  > 


Using  tho  rolotionship  P(XHjHj)  ■  P<x»*jHi)  -  P(xh|H,)»  in 
(3-24) p  wo  rowrito  Ro  os 


R»  -  C  ♦  IC  P(u-l|x>.)CO  P(x»*|Ho)  -  Co  P(x»*|H»)3 


♦  CP(u«l|xj.)  -  P(u-1|Xh)3CO  P(xh|Ho)  -  CoP  (  x>*  |  H»  )  3  ) 


(3-25) 


•^n 


Ar**  -  P(u«i|i(>.>  “  P(u-i|ic,.; 


<  3-Z6-m ) 


-  Z  P(u>l|K>.)  CC.-  P(x»*|Ho) 
x»* 


Th«n»  Rb  mmy  bm  written 


-  Co  P(x»‘|H»)3  ♦ 


( 3-S6-b ) 


-  £  Ak*‘CCp'  P(Xh|Ho)  -  Co  P(XK|Ht>3  *  C^ 
X** 


( 3-27 ) 


P<K| 


H..  -  J 


P(x|y.).  p(Y|H4>  dY 


( 3-28 ) 


Mhvr* 


i»  th«  integral  over  all  poeeible  elementa  of  Y 


( 3-29 ) 


Recall  our  earlier  aeaumption  that  the  decision  of  each 
detector  depends  only  on  its  onn  observation.  Therefore*  we 
«ay  write 


P<><|Y)  -  Jj  P<u*|yt) 


( 3-30-a ) 


Substituting  from  13-33)  into  13-35) »  wm  gmt  thm  following 
dmcisior.  rulm 

Uh*1 

p(y>.|Hi)  Z  [  Ax**  Co  P1m**|Y**)  ptY**|yH>Hi)  dY** 

><*•  J  < 

Y**  Uh-0 


P(^m|Ho)  r  Ax**  C.-  Plx**|Y**)  p(Y**|yH.Ho)  dY** 

><**  J 

Y**  (3-34) 


It  is  clmsr  from  (3-34)  that  P(u».|y>)  can  ba  aithar  0  or  1 . 
ThuSf  wa  hava  a  non  randomizad  dacision  rula  for  aach 
datactor . 

Q.E.D. 

Corollary  3.1 

Tha  ovarall  solution  to  tha  binary  Bayasian  DDF 
problam*  i.a.»  obtaining  tha  dacision  rulas  at  tha 
individual  datactors  and  tha  fusion  rula  which  jointly 
ffliniffliza  Rb»  is  obtainad  by  solving  N  aquations  of  tha  form 
(3~34)  and  3*^  aquations  of  tha  form  (3-15)  simultanaously . 
Wa  ramark  that  tha  abova  aquations  ara  couplad  and 
nonlinaar.  It  is  a  difficult  task  to  solva  tham  whan  N 
bacomas  larga.  Tha  casa  of  indapandant  obsar vat ions  is 
discussad  latar  in  Saction  3.4.  In  this  casa»  tha  aquations 
ara  aasiar  to  daal  with  and  tha  dacision  rulas  at  tha 
Individual  datactors  bacoma  classical  likalihood  ratio 
tasts . 
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In  th«  next  ■•ctioni  w«  gansralir*  th«  rsBults  to  the 


cos*  of  N  dotoctoro  and  n  hypothMos. 

3 •  3  G«n9rii_Ii.ijiMAn_tfi  M-ary  HvPoth>»i»  Tdotina 
3.3.1  Problaa  Stat— nt 

In  thia  aaction*  wa  conaidar  tha  Bayaaian  DDF  problam 
illuatratad  in  Figura  3.1*  with  N  daciaion  aakara  and  n 
hypothaaaat  HoiHi t . . . (Hn-i .  Each  daciaion  aakar  i»  uaaa  ita 
obaarvation  vactor  yi  to  aaka  a  daciaion  ui*  i*l»S»...»N. 
Dapanding  on  whathar  tha  i**'  daciaion  aakar  dacidaa  Hot 
Ha  t . . .  t  or  Hri-at  Ua  aay  taka  tha  valuaa  Otlt...t  or  n-i 
raapactivaly .  Knowing  tha  daciaion  vactor  xt  which  containa 
tha  daciaiona  of  tha  individual  daciaion  aakarat  i.a.t  B  ■ 
(ua  tu«t . . .  tUM)'^t  tha  global  daciaiont  ut  ia  aada.  Thia 
global  daciaion  aay  again  taka  tha  valuaa  0tlt8t»*>t  or  n-1. 
It  doaa  not  dapand  on  tha  obaarvationa  at  tha  individual 
daciaion  aakara.  Harat  wa  davalop  tha  thaory  of  Bayaaian 
hypothaaia  taating  for  tha  ganaralizad  DDF  ayataa#  i.a.t 
obtain  botht  tha  fuaion  rula  and  tha  daciaion  rulaa  at  tha 
individual  daciaion  aakara  ao  aa  to  ainiaiza  tha  avaraga 
coat  Rb.  Nowt  wa  atata  a  laaaa  that  wa  will  uaa  for  tha 
aolution  to  our  problaa  in  tha  naxt  aubaaction. 

Laaaa  3.1 

M-1 

Lat  F  ■  £  Pk  Ck  whara  Ct  ara  known  poaitiva  conatanta 


tA 


V3 


m 


n-i 

and  Pk  aatiafy  Z  Pk  ■  1  andt  Pk  2.  0.  Tha  Minimum  valua  of 
i«0 


Ft  F«.kr.t  is  aqual  to  C«,kr>t  Mhara 


Cm  km  *  Min  CCotCki«*«t  Ct^*-  X  ^ 


This  minimum  Fmkm  ia  achiavad  by  Batting 


for  Ck  *  Cm k m 


otharwiaa 


3 . 3 .  S  Op  t  i  mum  .€>y 9 1  am 


Tha  ganaralizad  rasult  is  statad  in  tha  following 


thaoram 


Thaoram  3.3 


AsBuma  that  tha  coata  Ck^t  itj  *  Otlt>>*tM-l  and  tha  a 


priori  probabi 1 itiaa  ara  known.  For  tha  Bayaaian  DDF  ayatam 


of  Figura  3. It  tha  optimum  fuaion  rula  and  tha  optimum 


daciaion  rulaa  at  tha  datactora  ara  obtainad  by  aolvlng  tha 


following  aata  of  aquationa  aimultanaoualy 


1  if  Cm*<Ck*  for  all  it  i-0,1 . M-1 


P(u“m|  ><*>  ■ 


and  i  ^  m. 


0  otharwiaa. 


for  all  x*t  X*  ■  (ui*tu«*t . . .  tu».i*)'^t  Ui.*  ■  Oilt...tn-l 


P(u^"h|y*. ) 


if  i  Ih<m)  for  all  m*  ouch 

that  and  h»«  ■ 


otharNiaa 


H  ■  »N 


whara 


.  M-l 

Ci«  r  Cij  P<)<-(H^)  P(Hj) 
j-0 


and*  XH(h)iB  givan  by 


M-i  M-l  r 

lH<h)-  Z  Z  p<yH|H4)  dY**  PjCi* 

1-0  J-0  J 

Y** 


* 

„  z  cp(u-i |.HH)-P(u-i P(x»*|y»*)  p(Y**|yH»H,> 

K** 


In  this  caaa*  wa  writa  tha  Bayaaian  risk  that  wa  niah 
to  miniaiza  aa 


M-l  M-l 

R»  -  £  £  Pj  Pr  (dacida  H*|Hj  ia  praaant) 

1-0  J-0 


M-l  M-l 

R.  -  £  £  P(u-i|Hj)  P,  C*j 

1-0  J-0 


(3-33) 


.  •  «  •  k  •  •  •  .  •  ■  •  ^  k^  -  •  J»  »  V  '  J*  '  1,^  •>  •, 


IS 


whara  again*  C* «  is  tha  coat  of  daciding  H*  whan 
praaant  and*  is  tha  a  priori  probability  of  hypothasis 

i«J  ■■  Racall  our  aaauffiption  that  tha 

global  daclaion*  u*  doaa  net  dapand  on  tha  obaarvations.  It 
only  dapanda  on  2$.  Tharafora*  Ma  may  writa 

P<u-ljH^)  -  r  Pr<u-l|«)  PrCujHj)  .  0-36) 


Subatituting  (3-36)  into  (3-3S)  »  wa  hava 


H-1  n-1 

R>  -  Z  £  Z  P(u*ijx)  P(xjHi)  P(Hi)  Cij 

K  imQ  jmQ 


0-37) 


Naxt*  wa  procaad  with  tha  aolution  to  our  problam. 
Firatp  obtain  the  optimum  fuaion  rule  which  minimizea  R*. 

ORi  i9um..Fi4iion  .RmIji 

While  deriving  tha  fuaion  rule*  wa  aaauma  that  tha 
daciaion  makara  have  already  bean  daaignad.  Tharafora* 
P(x|Hj)  ia  known  for  all  poaaibla  daciaion  vactora  x» 
X  ■  (ui  f  u«f . . .  f Un) Let  X*  «  (ui*  »u«** . .  .  tUM* be  one  of 
tha  poeaibla  daciaion  vactora.  Separating  tha  terms 

which  depend  on  x*  in  (3-37)*  R*  may  be  expressed  as 


M-1  M-1 

R.  -  Z  P(u-ilx-)  Z  C(u-i*H3)  P(x-|H4)  P(H3) 
i-0  j-0 


M-1 

Z  Z  P(u-i lx) 
i-0  }<fx* 


M-1 

r  Cij  P(x|H,)  P(H^) 
J-0 
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(3-38) 


m 


•.'j 


I 


a 


In  •quation  (3-38) »  « t  PCHj)  and  P(k|Hj)  ara  known 
for  all  i»j  such  that  iij  *  0»l»...»n-l  and  all  vactora  x. 
Tharafora*  tha  aacond  tara  doaa  not  dapand  on  P(u*i|x**)  and> 
minimizing  with  raapact  to  P(u*  |x^)  minimizaa  R»i  whara 


M-1  M-l 

R*-  «  Z  P(u-i|x-)  Z  Pix-jHi)  P(H3) 

i*0  j-0 


(3-39) 


Nowf  applying  tha  raault  of  Lamma  3.1  to  our  problam» 


whara 


Ci-  Z  Cl,  P(x*jH,)  P(H,) 
j 


(3-40) 


Rsmir.  ia  achiavad  by  aatting  P(u«m|x'^>  *  1  for  tha  valua  m 
of  u  for  which  Ci*  ia  minimum.  In  thia  caaa  tha  valua  of 
R»min  ia  aqual  to  Cm*.  Thua»  tha  optimal  fuaion  rula  ia 


P ( u"m I  X* )  ■ 


1  If  Cm*  i  Cl*  for  all  i  auch  that 


i  ■  0»l»...»n-l  and  i  ^  m 


0  otharwiaa 


(3-41 ) 


Thia  last  aquation  atataa  that*  for  any  daciaion  vactor 
X*  ■(ui*»ua* • . . . fUM*) «  tha  fuaion  cantar  dacidaa  that  Hm  ia 
praaant  whara  Cm*  •  mintCo**Ci*» . . . »Cm-,*>. 


Naxtf  wa  obtain  tha  daciaion  atratagiaa  at  tha 
individual  daciaion  makara.  Wo  obtain  tha  daciaion  atratagy 
at  tha  datactor»  h  ■  1,8»...*N.  Whila  dariving  tha 
daciaion  atratagy  at  tha  datactor»  h  ■  lia,...»N,  wa 


•••UM  that  all  tha  othar  datactora  hava  alraady  baan 


daaignad. 


Qeli  auffl.  JhKis&isrji 


Racall  that  R*  la  givan  by  (3-37) 


Wa  raproduca  i t 


hara 


n-i  n-i 

£  £  Pj  C44  £  CP(u-i|x>  P(h|H4>1 

i^O  i*0  K 


(3-37) 


In  taraa  of  Ht  tha  datactor*  R»  aay  ba  raMrittan  aa 


M-1  tt-l  M-1 

R.  -  £  £  Pj  £  £  £P(u>i|j<>.)  PC^hIH^)]  (3-4S) 

1>0  j^O  kaO  H 


Hhara 


R**  *  (Ut  fUsf  •••  tUH—s  fun'll  »•••  vUm)' 


(3-43-a> 


{(h  *  (  U  X  I  U«i  «  •  •  f  U»«*k  »  •  •  •  vUm) 


( 3-43-b ) 


£  a  Buaaation  ovar  all  poaaibli 


iluaa  of  Km.  (3-43-c) 


Racall  tha  aoauaption  thatp  aach  datactor’a  daciaion 


dapanda  only  on  Ita  obaarvation  and  that  it  doaa  not  dapand 


on  tha  hypothaaia  praaant.  Tharaforai  wa  writa 


P(H| 


Hj)  -  I 


P<n|X)  p(X|H,)  dY 


<  3-44 ) 


2 


Mhich*  using  our  ssrlisr  sssuaptlon  that  dscisions  st 
difforont  docision  asksrs  ars  indspondsnt*  bscoMss 


r  Brl 

P<>t|H4)  -  II  P(u«|y-.)  dY  (3-4S) 

J 

Y 


Bimilarly» 


P(>(».|H>)  •  J  dy».  P(UH*k|y*.)p<y».|Hj) 

y*- 

«  I  dY**  P(x**|Y**>  p(Y**|yH»H4>  (3-46) 

Y** 


Mhoro  y**  sndf  J  Horo  dsfinsd  in  (3-5)  and  (3-59) 

y** 

rospsctively  and* 


_  J5=l 

P(K**|Y»*)  -  II  P(u«|y«)  (3-47) 

••0 


Substituting  from  (3-46)  into  (3-45)  and  intsrchanging 


■u«M«tion  and  intagration  ovar  Ma  aay  rawrita  R»  ac 


h-1  M-i  r 
£  £ 
j«0  k*0  J 


P(UH~k|yH)  p<yH|H3> 


M-1  1. 

£  £  P(u-1|xh) 

l-O  »** 


P<.>t**jY»*)  p(Y**|y,.,H,  >  dY 


(3-4B) 


Wa  hava  tha  following  ralationahipf 


I  dy^  P(UH-l<|yH)  p(yH|Hj)|  dY**  P(k/*|Y>*)  p(Y*‘|yH»Hi 


I  P(UH-kjy,.)  p(yH|Hj)|  P{x»*)Y»‘)  p(Y**|yHiH3)  dY 


if  k^j 


1(1  -  £  P(UH-h|y».>>  P<yH|Hj)  [p(x'*|Y'*)p(Y'*|yH.H,)  dY 

h"0  J 

yj,  h^j  Y»*  if  k«j 


(3-49) 


Using  tha  abova  aquationp  R»  can  ba  axprassad  as 


R»  -  K(h)  *  R»(h} 


(3-30) 


SV 


V  V  V_  •  . 


••.  ■*. 


% 


wh«r« 


K(h> 


.V\ 

i«oJ 


ptyHlH^)  £  Pj  £  P(u*i|)(»4) 
1*0  &*• 


-I 


dY  P(K**jY*‘)  p(Y**|yH»H,> 


(3-Sl-«) 


•ndi 


M-i  ri-i  r  n-1 

R»(h)  -  £  2:  P(UH-h|yM>  pCyMiH^)  £  P^  C^t 

j«0  h-0  J  l-O 

j  y>. 


«  <  £  CP(u«i  I  KH)>P(u-i  I  Kh>3>  dY  P(j<»*|y**)  p(Y»*  |  y>.  tH*  > 
X*'  J 

Y** 

(3-51-b> 


W«  rMiark  th«t«  K(h?  is  m  constant  indopandont  of 
P(UM*ti I  Yh )  •  Than*  miniaizing  R»  Hith  raapact  to  P(UH*h|yH) 
is  aquivalant  to  minimizing  Rsih).  ma  dafina  IhCH)  as 


lH(h) 


M-l  M-1  r 

-  £  £  piy^lH,)  dY**  P*C», 

l-O  j-0  J 


«  £  CP<u-i|iiH)-PCu-i  ja^)D  P<a**|Y**>  p<Y**|y»*»H3  > 

H** 

<3-32 ) 


Substituting  from  (3-52)  into  (3-91 )»  »«s  hsvs 


P  M-1 

R.(h>  -  dy>.  Z  P(u*.*hjyM)  Inih)  (3-93) 

J  h>0 


Thsrsfors*  it  is  possibls  to  minisizs  RB(h)t  snd 
conssqusntly  Rbi  by  choosing  ths  folloMing  dscision  strstsgy 
for  ths  dscision  ssksr  h« 


P(uM“h  I  y*. ) 


1  if  lH(h)  1  Ih(s)  for  sll  m  such  thst 
h^  snd  h(S  •  0»i»...»n-l 

( 3-94  > 

0  othsrwiss 


Rspssting  this  procsdurs  for  sll  of  ths  N  dscision 
ssksrs*  s  totsl  of  N  squstions  is  obtsinsd.  Simultsnsous 
solution  of  thsss  squstions  yisld  ths  dscision  strstsgiss  st 
sll  dscision  nsksrs  which  miniiiiizs  R». 


Agsinp  nots  thst  thsss  dscision  strstsgiss  srs 
nonrsndomizsd.  Ths  squstions  srs  couplsd  snd  highly 
nonlinssr.  Thsrsfors*  ths  solution  is  not  strsightforwsrd . 
This  problsm  bscomss  sssisr  if  ws  sssums  thst  obssrvstions 
St  sll  dscision  msksrs  srs  indspsndsnt  of  ssch  othsr.  This 
Isttsr  csss  is  discusssd  in  ths  nsxt  ssction. 


Ovsrsll  Solution 

Ths  ovsrsll  solution  to  ths  n-hypothssis  Bsyssisn  DDF 
problsffl  with  N  dscision  nsksrs*  i.s.*  obtsining  ths  dscision 
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rul«B  mt  th»  individual  dacision  niakars  and  tha  fusion  rula 


Nhich  ainimiza  R»»  ia  obtainad  by  solving  N  aquations  of  tha 
fora  <3-54)  and  aquations  of  tha  fora  <3-41 ) 

siaultanaously . 

Q.E.D. 

In  tha  naxt  saction»  wa  considar  tha  Bayasian  DDF 

problaa  Mhan  tha  obsarvations  at  tha  dacision  aakars  ara 

indapandant  of  aach  othari  and  soaa  othar  spacial  casas. 

3 . 4  Spaqi LJCpsjis 

In  tha  pravious  saction#  Ma  obtainad  tha  solution  to 
tha  DDF  problaa  with  M  hypothasas  and  N  dacision  aakars  so 
as  to  ainiaiza  tha  Bayasian  risk.  Tha  solution  consistad  of 
N  aquations  which  aust  ba  solvad  siaultanaously  to 
yiald  tha  dacision  rulas  at  tha  individual  dacision  aakars 
and  tha  fusion  rula.  Wa  notad  tha  coaputational  difficulty 
in  obtaining  tha  solution  dua  to  tha  coupling  and 

nonlinaarity  of  tha  aquations.  This  coaputational 

difficulty  is  raducad  considarably  by  invoking  tha 
indapandanca  asauaption  on  tha  obsarvations  i.a.f 

P<Y|Hj)  -  j(  p<y«|H4}  <3-55> 

Naxtf  wa  prasant  tha  solution  to  tha  Bayasian  DDF 

problaa  with  indapandant  obsarvation. 
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VI 


M-i  n-1 

lK<h)  -  Z  L  p(yH|H«)  P*  C»3 
i-0  j-0 


ZCP(u-i|xH)  -  P(u«i  j.XM)3  I  I  P(u«|y«)  pCy-JHi)  dy„ 

x^  m«l  J 

«»+**  y^ 

( 3-S7-b ) 


Binary  Case 


In  tha  caaa  of  binary  hypothaaia  taatingi  wa  may  uaa 
tha  procadura  davalopad  in  Chaptar  S  and  gat •  tha  fol lowing 
likalihood  ratio  taata 


fin (yn ) 


p(yHjHi)  > 

p  ( y.M  I  Ho )  < 

Ho 


H  “  ( 3~96 ) 


P(u-1 I x>-l 
Dx  >  Cf- 

Fx  <  Co 

P<u-1 I x>»0 


for  all  X 


( 3-59 ) 


whara 


H  1  MO 


-  Po  <Cio  -  Coo)  Z  Fx-  <P*X  -  Pi*> 


P»  (Coi  -  Cii  )  Z  Mx»*  <P< 


-  Pox) 


( 3-60-a ) 


( 3-60-b ) 


-  II 


H 

So 


(1  -  P.-j)  I  I  Pi-» 
Si 


Mk* 


I  I  II  (1  ~  Pwfc ) 


So 


11 


H 

Si 


<1  -  Poi) 


Fx-  -  I  I  <1  -  P-^) 


ii 


M 

n 


'OK 


<  3-60-c ) 


(3-60-d) 


(3-60-«) 


( 3-60-f ) 


'M, 


P^K 


probability  of  daciding  j  whan  tha  daciaion  of 
datactor  H  ia  k  and  k  ia  giveni  kij  ■  Oil  andf 
H*li5(<i««iN  ( 3~*60~g ) 


and( 


H  ** 

So*  Si*  So  and  Si  ara  givan  by  (S-6>  and  (S-IS) 

Nota  that  tha  aolution  of  tha  binary  Bayaaian  DDF 
problaffl  raquiraa  tha  aolution  of  5*^  •«'  N  aquationa.  Thara 

ara  S*  poaaibla  fuaion  rulaa  and  wa  muat  aalact  ona 


growa  vary  rapidly  with  N.  In  ordar  to  mi 
tractabla*  wa  naxt  obtain  tha  aolution  for 


_N 


thi 


p(Y|Hi)  -  ||^p(yi|Hi) 
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•A" 


• 

on  rulaa 

7*7' 

. 

problam 

-■  «»•  ■ 

n 

a 

a 

a 

o 

• 

■  9 

'vlv 

m 

(3-61-*) 

’JIT 

% 


P(Yk|H3)  -  p(Y»,|H^) 


for  ^11  h*k|  h»k  « 


J  -  0,1 


(3-61-b) 


3 • ^ • 2  Idonticol  Dotoctoro 


In  this  Bubsoction,  h*  contlnu*  with  th«  binary 
hypothniB  tBBting  problBfli.  Wb  bbbuiiib  that  tha  datBctora 


ar*  identical  with 


indBpandBnt  obBorvationa  (3-61-a) 


and  (3-61-b)  and  obtain  th*  optimuin  dociBion  rulBB  at  th* 
dBtBctora  and  th*  optiMum  fuBion  rul*  bo  bb  to  aiiniiniZB  R*. 


SincB  tha  datactoro  ara  idantical,  it  iB  obviouB  that 
all  of  tha  datactorB  Bhould  hava  tha  aama  thraaholda  and, 
conaaquantly ,  tha  aama  valuas  of  probability  of  dataction 
and  probability  of  falaa  alarm,  i.a.,  Po,  ■■  Pd,  and  Pk^i  ■ 
Pwi  for  all  i,j  Buch  that  i,j  *  1,S,...,N.  Thua, 


Pxxi  *  PxK,  for  all  Kx  and  k,  auch  that  jc,  and  x. 


hava  tha  aama  numbar  of  onaB. 


( 3-62 ) 


For  notational  convanianca,  wa  dafina 


Qj  >■  Prob(  dacida  u"1|k  containa  j  onaa)  j  ■  0,1,..., N 

( 3-63 ) 

Tharafora,  for  a  givan  valua  of  tha  thraahold  at  tha 
datactorB,  tha  fuaion  rula  ia  givan  by  tha  following  Bat  of 


I 


•quations* 


Qo“l 
N  > 

C(1-Pd)/(1-p»')3  L 

< 

Qo«0 


Qt-1 

<N-1>  > 

(po/ppr)  C(l-po)/(l-p^)3 

< 

Qi-0 


Qi-1 

I  (N-i>  > 

<Pd/P^)  C(1-Pd)/(1-Pp^)] 

< 

Qi-0 


Qm**! 

N  > 

<Pd/p^)  l 

< 

Q»m*0 


(■tags  0) 


(■tags  1) 


(■tags  N-i) 


(stag*  N) 


( 3-64  > 


whars  po  and  ars  ths  probability  of  dstaction  and  ths 
probability  of  falss  alarm  of  tbs  individual  dscision  maksrB 
rsspsctivsly »  and  L  •  (C^/Co). 


Sine*  H«  asBUfflsd  that  tbs  tbrosbold  is  known*  po  and  Pf^ 
ars  also  known.  claim  that  tbo  optimum  fusion  rula  in 
this  spocial  cass  rsducss  to  a  "K  out  of  N"  fusion  ruls. 
Nsxt*  ws  Justify  this  cboics  of  tbs  fusion  ruls  and  obtain 
tbs  optimum  valus  of  K. 


It  is  H«ll  known  that  tho  racaivar  oparating 
charactarlatic  curvaa  (ROC'a)  of  optiaal  datactlon  ayatama 
ara  convax  CISI.  Tha  ROC'a  of  tha  individual  datactora  in 
an  optimal  ayatain  ara  alao  convax.  Moving  down  in  tha  aat 
of  aquatlona  daacrlblng  tho  fualon  rula*  (3-64)  l.a.i  from 
ataga  1  to  ataga  i-*-li  1  ■  0»1»...»N-1»  wa  not  lea  that  wa  ara 
multiplying  tha  laft  hand  aida  torm  by  (po/pp-)  ( l-p^^)/ ( l-po)  • 
From  Figura  S.S-ai  wa  aaa  that  (po/pF-)  I  i»  and  from 
Figuro  3.S-bi  wa  obaorvo  that  ( 1-Pd>/( I-Pf)  i  1. 

Thoroforof  (po/p^ ) C ( l-p^ ) / ( l-po) I  la  alwaya  graatar  than  or 
aqual  to  unity.  Thuo»  if  tha  laft  hand  aida  tarm  bacomaa 
graatar  than  tha  right  hand  aida  torm  at  any  ataga  if 
iaOf 1 fSf . . . fN-1 f  tha  laft  hand  aida  tarm  will  ramain  graatar 
than  tho  right  hand  aida  tarm  for  all  furthar  atagaap  i.a.p 
for  all  j  auch  that  j  2  i.  Tharoforop 

Q  A  ■  Q 1  1  “Q  t  ■ .  • .  ■  Qp4  •  1  ( 3—63 ) 

which  la  cloarly  a  "K  out  of  N”  fualon  rula. 

Naxtp  wa  obtain  tha  optimum  valua  of  Kp  K<.p*p  which 
ffiinifflizaa  R*  for  tha  "K  out  of  N”  fualon  rula. 


Uaing  a  **K  out  of  N"  fualon  rulop  tha  probability  of 


th«n  claarly  It  hM  •  slngl*  MiniiMiiii  at  on*  of  its  and 


points.  OtharwiMf  It  rMsins  to  b«  shown  that  it  hss 
SMSctly  ons  dscrsssing  part  and  ons  incrsasing  part  Implying 
that  it  has  a  singla  minimuiii.  To  show  this#  ws  sxamins  ths 
sign  of  {R»(K*-*-l)  -  RbCK')!#  or  squi valsnt ly t  tha  sign  of 
F(K’)»  whsrs 


RviK’-*-!) 


R.(K' )- 


N  K'  N-K'  K’  N-K' 
(  )  CCd^PdICI"  Pd)  C^(Pf’)  ( l^pr)  3 
K' 

0-6B-a) 


and* 


K*  N-K’  K’  N-K’ 

F(K’)  -  CCd(Pd)  (1  -  Pd)  -  C*r(p,.)  (  1  -  p,.)  3 

(3-bB-b) 

Ths  function  F(.)  can  bs  ussd  to  sxprsss  ths  naturs  of  ths 
function  R»< . )  as  follows 

R.<K’)  <  R.(K’+1) 

> 

F<K’)  0  (3-69) 

< 

R.(K’  )  >  R.(K’-^1) 

Now*  1st 

K’  N-K’ 

Q(K’)  -  (pD/pf')  C(1  -  Pd)  /  (1  -  p.-)  3  (3-69-a) 


Thsn*  (3-69)  is  squivalsnt  to 


Rvarranging  (3-7S)i  Na  hava 


K*log€(po/p^) (1  >  p^)/(l  -  po)> 


R»(K’)  <  R.(K’-^l) 


>*■  N  legCCl  -  Pd)/(1  -  p.->>  logCL> 

< 

R»(K*)  >  R»(K'4-1) 


<  3-73 ) 


Mhich  aay  ba  writ tan  as 


R»(K')  <  R»(K'-^1) 


>  N 

K*log<(po/p»r)  (l-p^)/(i-pB)>  logCL[(l-p,.)/(l-pD>3  > 

< 


R»(K’>  >  R»(K’4-1) 


( 3-74 ) 


Slnca  po  2  p^  and  1— po  i  1— p»rp  logC  (po/p^)  ( 1— pir ) / ( 1— Pd)  ^  is 
nonnagativa  and  tharafora*  »«a  can  divida  both  sidas  by  this 
tara  althout  affacting  tha  sign  of  tha  inaquality.  Thanp 
( 3-74 )  bacoaaa 


R»(K*)  <  R.(K’-M) 


log  tLCCl  -  p,-)/(l  -  Pd)!*^! 
log  <(Pd/p^)(1  -  p^)/(l  -  Pd>> 


( 3-73 ) 


R»(K*>  >  R»(K’<*-1) 


logCLCd  -  ppr}/<l  -  Pd)!**! 
logC  (po/p^)  <  1  p^>/(l  -  pd>} 


(3-76) 


I 


i 


!S:'' 

.41 


li 


I 

I 

I 

]u 

•C( 


Thus*  Kop*  is  givsn  by 


r-i 


K.^*  - 


if  N-  >0 


othsrwiss 


( 3-77 ) 


irs  I*  ]  is  ths  csiling  function. 


OvsrsH  Solution 


Ths  solution  to  ths  ovsrsll  problsm  i.s.»  optimum 
dscision  rulss  st  ths  dstsctors  and  optimum  fusion  ruls»  can 
bo  obtainsd  by  solving  squations  (3-S8)  and  (3-77> 
simultanoously . 


In  ths  nsxt  ssction*  ws  prsssnt  an  sxampls. 


3 . 9  Exampls 


In  this  ssctioni  ws  considsr  a  binary  Bayssian 
hypothssis  tssting  problsm  using  two  dstsctors  for 
illustration.  As  in  Exampls  8.1*  hs  assums  that  ths 
obssrvations  at  both  dstsctors  ars  indspsndsnt  and 
sxponsntial ly  distributsdp  i.o.p 


ixp(-y»  ) 


if  ypiO 


p(yp |Ho) 


i>l»8  (3-88-a) 


othsrwiss 


.*■ 


m 


4 


( 1/Ok  )«Kp i-y*. /Ot.  > 


If  yi>0 


p(yi|Hi) 


i-l,a  (3-B8-b) 


otharwis* 


H«r*»  H«  Mill  dvBign  th*  DDF  BystMip  i.«.»  obtain  tha 


optimum  fusion  rulm  and  thm  optimum  dmciaion  rulma  at  tha 


datactorsi  so  as  to  minimiza  tha  Bayaaian  risk  R».  Racall 


from  <S-36-a)  that»  tha  likalihood  ratios  at  tha  individual 


datactors  ara 


p(yi|Ht)  1 

Oi(yi)  - - - - axp  Cyid-d/Bi)  )>  i«l,a 

p<yi JHo)  ©» 


( 3-B9 ) 


and  tha  likalihood  ratio  tasts  (LRT)  ara 


Ht 

>  Bt 

-  InCtt  Bil  «  ti’ 

<  l-Bi 
Ho 


i  «  IpS 


(3-90> 


Tha  probability  of  miss  and  tha  probability  of  falsa  alarm 


at  tha  individual  datactors  ara  givan  by* 


d/d-9*  >) 

Pmi  -  1  -  (Bi  ti)  i  -  1*5  (3-91-a) 


(Bi/d-Bi)) 


1  “  ( Bi  1 1 ) 


i  -  i*a 


(3-91-b) 


Tha  thrasholds  and*  tha  inaqualitias  dascribing  tha  fusion 
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Figure  3.5  Optlmuni  Receiver  Operating  Characteristic  for  Example 
and  (  =  (6,8) 


fc'* 

S  >4' 
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1 


Si 

*I»«’ 


I 

i 


•s 
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other.  For  •xamplet  in  Figures  3.6f  3.7t  3.8>  end  3.9  we 
show  the  Rb’  vs.  K  curves  for  Po  •  0.6  end  (t'»0)  •  (SiS)i 
(6»S}»  (7»4>  and  (10»4>  respectively.  In  Figure  3.6f 
Kop«  ■  4t  in  Figure  3.7*  ■  1*  in  Figure  3.8»  Kop«  *  3 
and»  in  Figure  3.9f  Kc.p«  *  S. 


3.6  Discuss ion 


In  this  chapter!  we  have  presented  a  generalized 
approach  to  the  problem  of  distributed  Bayesian  hypothesis 
testing  with  data  fusion.  It  should  be  noted  that  with  a 
proper  cost  assignment  and  a  proper  fusion  rule*  the  DDF 
system  can  be  reduced  to  the  DD  system  which  is  thus  a 
special  case  of  the  problem  considered  in  this  chapter. 
Minimum  probability  of  error  is  widely  used  as  an 
optimization  criterion  in  the  design  of  optimum  detection 
systems.  For  this  criterion?  we  can  obtain  the  results  by 
simply  setting  the  costs  appropriately.  It  is  to  be  noted 
that?  in  general  I  the  fusion  rule  does  not  have  to  be  "AND" 
or  “OR".  The  fusion  rule  may  be  any  nonrandomized  rule. 


In  the  next  chapter*  we  apply  the  results  obtained  in 
this  chapter  to  an  interesting  problem  in  radar  signal 
detection  namely*  double  threshold  detection. 
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$ 

I 


a 
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IV.  Doubl*  Threshold  Detection  With  Distributed  Sensors 


^•1  Introduction 


A  postdetection  integration  technique  known  as  double 
threshold  detection  is  often  employed  for  target  detection 
in  radar  systems.  Greater  detectability  can  be  achieved  by 
using  predetection  integration.  But  due  to  simplicity  and 
cost#  postdetection  integration  is  often  implemented  even 
though  its  performance  is  slightly  poorer. 


A  block  diagram  of  the  double  threshold  detection  system 
is  shown  in  Figure  4.1»  CSl.  Out  of  N  waveform  envelope 
samples  coming  out  of  the  matched  filter  corresponding  to  an 
N  pulse  traini  the  number  of  signals  that  exceed  a  first 
threshold*  T**  at  the  sampling  instant  is  counted  .  If  this 
number  is  equal  to  or  greater  than  a  second  threshold  *  K* 
the  target  is  declared  present.  For  single  sensors*  this 
technique  has  been  analyzed  in  CS*  31-363.  The  system 
optimization  criterion  used  is  the  Neyman-Pearson  criterion. 
It  should  be  observed  that  the  double  threshold  detection 
system  and  the  binary  DDF  system  with  identical  detectors 
considered  in  Section  3.6.2  are  analogous  and  the  results 
obtained  in  Section  3.4.2  can  be  employed  to  obtain  the 
results  for  the  double  threshold  detection.  From  our 
results  in  Chapter  3*  the  values  of  the  two  thresholds* 
namely*  K  and  T  (T  is  related  to  T*  through  the  likelihood 
ratio)*  are  given  below 


(4-1 ) 


r  Po  (1-p^)  ■% 
log  ( - ) - 

*•  (  1— Po)  J 


whoro 


Pp^^  b  th*  probability  of  falaa  alarm  of  an  almmmnt  of 
thm  obsarvation  vmctor 


Po  *  thm  probability  of  dmtmction  of  an  element  of  the 
obmmrvation  vmctor 


L  is  thm  Lagrangm  multiplimr. 


Thmn»  thm  optimum  valum  of  K  im  givmn  byi 


if  N-  >  0 


othmrMimm 


(4-2) 


Thm  valum  of  thm  thrmshold*  T»  In  thm  llkmlihood  ratio  tmmt 
for  any  samplm  is  obtainmd  by  solving  thm  aquation  obtainmd 
aftmr  taking  thm  dmrivativm  of  aquation  (2-28) »  smtting 
iSPt>/SP^)  m  Tf  and  sotting  thm  dmrivativm  mqual  to  zmro. 
Thmn»  T  is  givmn  by 


T  -  L 


(4-3) 


wh«r« 


N  N  (i-1) 

Cf-  «  £  (  )  Cp,.  (  1 

1-K  1 


(N-l-l> 
p.')  (  i 


-  N  p,-)3 


N  N  (i-1)  (N-i-1) 

Co  -  £  (  )  Cpo  (  1  -  po)  (  i  -  N  po)] 

i-K  i 


(4-4-«) 


( 4-4-b ) 


Th*  probability  of  falsa  alarm  for  tha  dataction  systam  is 
aqual  to  a»  i.a.» 


“  a  • 


(4-5) 


Racall  that  tha  probability  of  dataction  and  tha  probability 
of  falsa  alarm  of  tha  datactor  wara  givan  in  (3-66). 


Naxtf  Ha  aKtand  tha  abova  rasult  to  tha  casa  whan 
multipla  sansors  ara  amployad  along  nith  a  data  fusion 
cantor.  Tho  schomas  ara  proposad  and  systam  paramatars  ara 
obtainad  for  aach  of  tha  schamas. 


tagration  With  Distributad  Sansors 


In  this  sactiont  ho  proposo  two  altornata  schamas  for 
post  dataction  intogration  Hhan  distributad  sansors  ara 
amployad.  Thaso  schamas  diffar  in  tho  bandwidths  raquirad 


for  channals  connacting  tho  sansors  and  tha  fusion  cantor. 


p 
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Schww  1 

Th«  block  diogrom  of  tho  first  schsms  is  shown  in  Figurs 


4.8. 

Each 

detector  i* 

receives  an 

observation  vsctor  y.*  * 

i  - 

i*s*.. 

.  *N.  Each 

observation 

vsctor 

consists  of  n 

components. 

Ws  assume 

that  sach 

dstsctor 

compares  sach 

slsmsnt  of  its  obssrvation  vsctor*  i  * 

J  •  l»5i...ini  to  s  thrsshold  If  ths  slsssnt  of 

ths  obssrvstion  vsctor  st  ths  i*^  dstsctor  sxcssds  ths  first 

thrsshold  »  ws  sst  ths  ths  slsmsnt  of  ths  decision 

vsctor  of  ths  i**'  dstsctor  equal  to  1*  i.e.»  «  If 

I  ■  ltSf...(N»  J  ■  l»S»...*n.  Othsrwisst  ws  sst  Uk^  *  O. 

Thus*  sach  dstsctor  1*1"  1*S*...*N  has  an  n-dimsnsional 
dscision  vsctor  *  m*  *  (u*  *  *Uke» . . .  »Ukr.> associated 

with  it«  Note  that  without  loss  of  generality  »  ws  have 
assumed  that  each  obssrvation  vsctor  y*  consists  of  ths  same 
number  of  elements.  Each  individual  detector  sends  its 
dscision  vsctor*  ut *  to  a  data  fusion  center  where  a  global 
dscision*  u*  is  mads  using  a  fusion  rule.  Ths  global 
dscision  is  based  on  a  dscision  vsctor  x  which  is  obtained 
by  concatenating  ths  dscision  vectors  u**  i  ■>  1»8*...*N* 

i  .s.  * 

"  (U*  *  *  Ui  e  *  •  •  *  U*  fi  *  Uai  *  UeB  »  •  •  *U*ei->  *  •  .  *  Um  t  *  Umb  *  •  •  *  Ur4t-i  ) 

(4-6) 

Next*  ws  present  ths  thresholds  at  ths  individual 
detectors  and  tho  fusion  rule.  Ths  results  are  obtained 
directly  from  ths  results  of  Chapters  8  and  3.  Wo  treat  the 
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probiMi  ••  •  mymtmm  Mlth  nxN  dstactor*.  Th«  goal  horo  la  to 
doolgn  a  ayatom  Mhich  alnialzaa  tha  probability  of  aiaa* 
Mhan  tha  probability  of  falaa  alara  ia  conatrainad  by 
Pit  ■  «  5  a’.  In  thia  caaa*  tha  optiaua  fuaion  rula  ia  givan 
by 

-  ain  <a*,l> 

> 

1  L«  (4-7) 

< 

P»K*  -  0 

and*  tha  thraahold  in  tha  likalihood  ratio  taat  ia 

T  »  L  — - -  (4-B) 


Hhara 


a*  ■  a  —  £  P»it  Pno  (4—0— a) 

afK* 

and*  PiK»  Pbo  ara  givan  in  (S-9).  Cmh*  and  ara  givan 

in  (S-19>  axcapt  that  tha  aubacript  pj  corraaponda  to  tha 
alaaant  of  tha  daciaion  vactor  of  datactor  H* 
H  ■  l*a«a*N  and  *  4  ™  l*«««*n» 

6cbJ»a_^ 

Tha  block  diagraa  of  tha  aacond  achaaa  ia  ahoan  in 
Figura  4.3.  In  thia  achaaa*  aach  datactor  acta  aa  a  doubla 


thraahold  datactor 


on  ita  OMn  daciaion  vactor 


^  UitfUkK*..«»Ukn  )'''>  it  us»s  •  m»cond  threshold 
to  ««k«  «  dociolon  u&»  i  which  is  ssnt  to  ths 
data  fusion  cantar  whara  a  global  dacislon  *  ut  la  mada. 
Tha  function  to  ba  aaxlmizad  in  this  caaa  is  tha  following 


r  -  Po  -  L  CP,-  -  «3 


(4-9) 


or  aquivalantly * 


r  -  Z  P, 


-  L  C  E  Pxx  F*  -  «  3 


(4-10) 


whara  Po  and  P^  ara  tha  global  probabi 1 itias  of  detection 
and  falsa  alarm*  raapactivaly .  P*k*  Dx»  and  Fx  wara  dafinad 
aarliar  in  (2-3).  For  any  spacific  dacision  vactor  x*,  the 
fusion  rule  is  given  by 


Pin.*  »  min  €«•,!> 


(4-11 ) 


whara 


•  o  —  Z  P»o  P»x 
x^* 


(4-11-a) 


L  -  L 


(4-11-b) 


Tha  second  threshold  Km  for  detector  H*  H  ■  1»H,...,N  is 


givan  by 


r  "*i 


Kh  ■■ 


If  N-  >  O 


Otharwis* 


(4-ia) 


log  L 


1“P^»« 


(4-12-0) 


[P*»H  1~P^»* 

-  - 

l^P^H  l“Po»* 


p^H  ■  probability  of  falao  alarm  of  any  alamant 
of  tho  obsarvation  vactor  of  datactor  H 


Pom  "  probability  of  dataction  of  any  alamant  of 
tha  oboarvation  vactor  of  datactor  H 


Pmm  •  probability  of  falaa  alarm  of  datactor  H 


n  n  (1)  in-l) 

Pmm  -  r  <  )  Pmm  (l“P»rM) 

I-Km  1 


«  -  Ki 


H  -  1 »a» . . . ,N 


(4-13) 


r  --  •.  •,  %  •  •.  •-  *• .  -  •  -  * .  •  .  • « “  •  •  ^  .•  *  . 


Pdh  ■  probability  of  dotoction  of  dotoctor  h 


n  n  (i)  (n— i> 


-  Z  (  >  Pdm  (1-Pd».)  <4-14) 

1-Km  i 

Cifh 

Lh  -  L -  (4-lS) 

Cdh 

f  Ml  MO 

Cmm  «  Z  Fx  <Pix  -  Pik)  (4-16) 

X 

»«  Z  HO 

Com  “  Z  Du  (PiK  —  Pik)  (4—17) 

>< 

M  MO 

K.M  -  z  Fk  Pi*  (4-18) 

X 


^  f  /  ^ 


Th»  first  thrssholdy  tn*  of  dstsctor  H  is  givsn  by 


tn  -  Lm 


(4-23) 


n  n  (i-1)  (n-i-l) 

CVh  -  £  <  >  Cpf'H  <1  '  P»m)  (i  -  n  p..H>3  (U-B6-a> 

i-Kn  i 


n  n  (i-1)  (n-i-l) 

C*DH  “  £  (  )  CpOH  (1  -  Pdh)  (i  -  n  Pd».)3  (4-26-b) 

I-Kh  i 


sndt  p^H  snd  Pdh  srs  ths  probsbility  of  fslss  slsrs  snd  ths 
probability  of  dstsction  of  sn  slsmsnt  of  ths  obssrvstion 
vsctor  of  dstsctor  h« 


Ths  ovsrsll  solution  to  ths  problsm  is  obtsinsd  by 
solving  (4-11) »  (4-12)  snd  (4-23)  simultsnsously .  In  ths 
spscial  csss  Mhsrs  ths  dstsctors  srs  idsnticsl*  ws  could 
viSM  it  ss  s  trip Is  thrsshold  dstsction  systsm*  whsrs  ths 
squstions  bscoss  sssisr  to  solvs. 


V.  Dlstributvd  MinliKun  Equivocation  Dotoction 
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5.1  Introduction 


In  otatiotical  docioion  thoory*  •  variaty  of  critaria 
ara  uaad  for  tha  optimization  of  datactora.  For  axaapla>  in 
tha  Bayaaian  formulation  a  fixad  coat  ia  aaaignad  to  aach 
poaaibla  couraa  of  action  and  than*  tha  avaraga  coot  ia 
minimi zad.  In  applicationo  whara  auch  cooto  ara  aval labia 
and  ara  maaningful*  Bayaaian  coot  formulation  providaa  an 
axcallant  choica  for  oyotam  optimization.  Howavar*  thia  may 
not  ba  tha  caoa  in  all  applicationo.  In  aoma  applicationo* 
our  intaraat  may  bo  tha  amount  of  information  that  no  ara 
ablo  to  tranafor*  a.g.*  in  talaphona  channala  wa  ara 
concarnad  with  tha  amount  of  information  tranamittad  rathar 
than  tha  natura  of  tha  information  itaalf.  In  auch 
oituationo*  coat  may  bo  a  variabla  and  ontropy-baaad  coot 
functiona  may  ba  mora  maaningful. 


In  thia  chaptar*  ho  ohall  uaa  antropy  baaad  coot 
functiona  and  dorivo  optimum  multioonaor  dotaction  oyatamo. 
For  oingla  oanoor  dotaction  problama*  Middlaton  C893*  uaad 
ouch  a  critorion  for  tha  dooign  of  an  optimum  docioion 
oyotam  ahara  ha  minimizad  tha  aquivocation  bataaan  tha  input 
and  tha  output.  In  tha  naxt  oaction*  aa  aill  roviaa  aoma 
baaic  information  thaory  dofinitiona.  Wa  aill  alao  ahoa  tha 
corraapondanco  botaaon  tha  claaaical  binary  dotaction  ayatam 


and*  th«  binary  communication  channal 


Than*  we  praaont  tha 
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raaulta  for  tha  aingla  aanaor  caaa.  In  Eaction  9.3*  wa 
Bolva  tha  minimum  aquivocation  dataction  problam  for  tha  DDF 
ayatam.  In  Eaction  9.4*  na  praaant  tha  aolution  to  tha 
minimum  aquivocation  dataction  problam  for  tha  DD  ayatam. 
In  Eaction  9.9*  wa  praaant  a  numarical  anampla. 


S.S  ^n*l-i.fflinariaa 


9 . S . 1  Baa i c  I nf prmat ion  _Thaory  Daf ini t iona 


In  thia  aaction*  firat  wa  briafly  praaant  aoma 
dafinitiona  from  information  thaory  £41*  4S1*  which  will  ba 
uaad  in  tha  raat  of  thia  chaptar.  Lat  k  and  y  ba  two 
diacrata  random  variablaa  taking  valuaa  from  tha  aata 
£ki  *Ke» . . .  *M*i)  and  £y *  *ye * . .  •  vyix)  raapactivaly .  Lat  PCxm) 
and  P<yr.)  danota  tha  aaaociatad  probability  maaauraa  and 
P(Km|yn)  and  P(Mm*yr<)  danota  tha  conditional  and  joint 
diatributiona  raapactivaly. 


Tha  antropty  h(x)*  which  maaauraa  tha  uncartainty  about 
M  ia  daf i nod  by 


hiM)  -  E  Clog  Cl/P<x)]}  -  £  P(m)  log  Cl/P(>()> 


<9-1 ) 


Tha  conditional  antropy  (aquivocation)  h(x|y)*  which 
ffiBaauraa  tha  uncartainty  about  x  givan  y*  ia  givan  by 


h<x|y)  -  E  Clog  Cl/P(x|y)3)  -  £  £  P(x*y)  log  Cl/P(x|y)) 

X  y 

(9-2) 


Tha  mutual  information*  Z(x|y>»  ia  tha  amount  of  information 
providad  about  x  by  y  and  is  daflnad  aa 


Z(x|y>  ■  hCx)  -  h<x|y> 


Also*  wa  hava  tha  following  ralationahipa 


1 (xly>  *  I (ylx) 


(5-3) 


■  h(y>  -  h(y I x) 


■  h(x)  h(y)  -  h(x*y) 


(5-4) 


whara  h(x«y)  ia  tha  antropy  of  x  and  y*  dafinad  aa 


h(x,y)  -  E  {log  Cl/P(Xfy)]l  -  £  £  P(x*y)  log  Cl/P(x*y)l 

X  y 

(5-5) 


S.S.S  Corraapondanca  Batwaan  Datactton  Thaorv  and 


Information  Thaory 


Block  diagrama  of  a  claaaical  binary  datactlon  ayatam 
and  a  binary  communication  channal  arm  ahown  in  Figura  5.1. 
Wa  obaarva  tha  corraapondanca  batwaan  tha  two  problama  aa 
followa.  Tha  aourca  in  tha  dataction  problam  can  ba  viawad 
aa  tha  information  aourca  in  tha  information  tranamiaaion 


problam. 


Tha  boxad  part  of  tha  dataction  problam 


corraaponda  to  tha  channal  of  tha  information  tranamioaion 
ayatam.  Tha  daciaiona  in  Figura  5.1. (a)  may  ba  lookad  at  aa 
tha  output  of  tha  channal  in  Figura  5.1. (b)  Tha  probability 
of  datactton*  Po*  tha  probability  of  miaa*  Pm,  and  tha 
probability  of  falaa  plarm*  P^*  In  tha  dataction  problam  ara 


Probobilistic 

Mecharrism 


Sa 
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•qulvalant  to  tho  transit ion  probabilitioa  for  tho 
inforaation  tranaaiaaion  problaa  aa  indicatad  in  Figura  9.S. 
In  thia  caaat  tha  input  ia  a  randoa  variabla  H  which  aay 
aaauaa  ona  of  tha  two  valuaa  Oorl»(H"i  corraaponda  to 
tha  hypothaaia  Hk  baing  praaant  i  *  0»1>.  Tha  output  is  tho 
daciaion  randoa  variabla  u  which  aay  again  aaauaa  tho  valuo 


of  0  or  1. 


Thoroforo*  tho  transition  probabilitioa  aro 


givon  as  follows. 


Tha  probability  of  daciding  **0"  whan  a  "0”  is  aant» 


P(u-0|H->0)«  is 


P(u-0(H-0)  -  1-P,- 


Siailarly f 


P<u-ljH-0)  -  P,- 
P<u>0|H-l)  -  Pn  -  I  -  P, 


(S-6-a) 


(S-6-b> 


(S“6-c> 


P(u-1|H-1)  -  Po 


(5-6-d) 


As  indicatad  aarliart  in  thia  chaptor  wo  will  conaidor 
dataction  problaas  wharo  wa  ainiaiza  tho  oquivocation 
botwaon  tho  input  and  tha  output.  Throughout  this  chaptor* 
wa  will  donoto  this  problaa  by  tha  HED  problaa.  In  thia 
caso*  wa  ara  intoraatod  in  ainiaizing  an  avaraga  cost*  whara 
tha  cost  is  not  a  constant  but*  is  a  function  of  tha  a 
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poBtariorl  probability  of  H  giv«n  u.  This  coat  function  is 

1 

C(u,H)  -  (3-7) 

P(H|u) 

Rscall  thstt  ths  svarsgs  Bayasisn  risk  is  dsfinsd  as 

R.  -  E<C(u,H)l  (5-8) 

Hhars  C(u»H)  is  a  constant  for  a  givsn  pair  u  and  H.  For 
ths  MED  problsfot  ths  avoraga  cost  is  ths  conditional  sntropy 
of  H  givsn  ut  i.s.« 

h(H|u)  -  E  <  log  Cl/  P(H|u)3>  (5-9) 

Knowing  Po  and  Pi »  our  problsm  is  to  obtain  dscision  rulss 
so  as  to  niinifflizs  ths  avsrags  cost  h(H|u)  which  is 
squivalsnt  to  ths  problsm  of  maxifflizlng  ths  mutual 
information  I(H|u).  This  is  obvious  from  ths  SKprsssion 
which  rslatss  I(H|u)  and  h(H|u)»  i.s.p 

KHiu)  -  h(H)  -  h(H|u)  (3-10) 

and*  rsalizing  that  h(H)  is  constant  whsn  ths  a  priori 
probabilitiss  Po  and  Pi  ars  known.  Thusp  ths  minimization 
of  squivocation  is  squivalsnt  to  ths  maximization  of  I(H|u). 

Latsr  on  in  this  subssctionp  ws  concluds  that  ths  point 
(PopPp*)  corrssponding  to  ths  dstsction  systsm  which 
maximizss  ths  mutual  informationp  llss  on  ths  rscsivar 

opsrating  charactsr itic  curvsp  (ROC)p  of  an  optimum  Bayssian 

1  1  s 


A 


dvtvctor.  In  ord«r  to  provo  thio  rvoult*  w«  first  nsod  to 
provB  ths  following  thsorsm. 


Givsn  ths  s  priori  probsbilitiss  Po  snd  Pi»  thsn  for 
Bsch  vsluB  of  ths  probability  of  falos  alarm  Pw  (or 
probability  of  dBtBCtion  Po)f  ths  minimum  mutual  information 
lmkn<H;u)  is  achisvBd  at  ths  point  whoro  Pd  «  Pf'. 


Proof 


For  thB  channol  modal  shown  in  Figurs  5.S>  ths  mutual 
information  KHfu)  is  givsn  by 


P(H|u) 

I(Hlu)  -  r  I  P(H,u)  log  < - > 

H  u  P(H) 


and  ths  a  postariori  probabilitiss  ara  ths  following 


P(u-O)  -  Po  (1  -  Pi-)  (1  -  Po)  (1  -  Pd) 


(5-11) 


■  «o 


(5-12-a) 


P(U"1 )  ■  Po  P^  ♦  ( 1  —  Po)  Pi 


■  «» 


(5-12-b) 


whara  Po  and  Pi  ara  tha  a  priori  probabilitiasi  P(Ho)  and 
P(Hi>  raspactivaly .  In  Figura  5.3»  wa  show  a  typical  skatch 
of  tha  iMitual  information  as  a  function  of  Pd  and  Pf'  for 
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given  a  priori  probabilities.  Substituting  from  (9-lS)  into 
<9-11)  and  cancelling  teres*  ms  get 


KHiu)  - 


(l-P,-> 


log 


log 


*  (l-Po)(l-Po)  log 


(1-Po)  Pi 


log 


1  -  P*. 

Po  (1-P*.)  +  <l-Po)(l-Po> 
Pi- 

Po  Pi-  ♦  (1-Po)  Po 
1  -  Po 

Po  il-P,-)  ♦  (  1-Po)  <  1-Po) 
Po 

Po  P*.  ♦  (1-Po)  P 


to  be  either  “O-  or  "I*',  i.e.*  P*.  «  p„  -  0  or  P^  «  P„  -  i. 


KHtu)  is  a  concave  upward  function  in  the  transition 


probabilities  P(u|H) 


(refer  to  Theorem  1.7*  [413*  for 

details).  Thus*  for  a  fixed  value  of  P*.  (or  Po)*  I(H|u)  is 
concave  upward  function  in  Po  (or  P^)*  as  shown  in  Figure 
9.4.  Therefore*  for  a  given  probability  of  false  alarm  P^* 
of  P*.  (or  a  given  value  of  probability  of  detection  Poi  of 
Pd)*  if  a  minimum  exists  and  is  interior  to  the  interval 
(0*1)*  the  value  of  Po  which  minimizes  the  mutual 
information  I(P*-i*Pd)  is  obtained  by  setting  the  derivative 
of  I(.)  with  respect  to  Pd  equal  to  zero, 
derivative  of  I(.)  with  respect  to 


Taking  the 
Pd*  we  have 


1  ]  & 


A.-V 


r'5'V' 

(9-13) 

maximum 

and  Pp* 

>5^ 


m 

s  *  1 


•  «  •  a 


VV 


V  V"J 

VA.I 


J*  ••  .* 

■^a  •  ■  ■  fc  •  a  •  •  * 


«Po 


Po  (  1“P^»  )  ♦  (l“Po)(l“P»)  Po  P^»  ^  Pb(  l"“Po) 

1  -  Po 


-  (1-Po)  log  - 

Po  (l-P,-l)  ♦  (l-PoXl-Po) 

(I  -  Po)Po  (1  -  PoXl  -  Po) 

^  _  - - - - 

Po  (1  -  Po) 

(I  -  Po)*  (l-Po) 


Po  (1-P^»)  ♦  (l-PoXl“Po) 


♦  (1-Po)  log 


Po 


Po  Pwx  (l-Po)  Po 


<1  -  Po)*  Po 
Po  P»-»  ♦  <l-Po)  Po 


(S-14) 


Rvorronging  <S-14)» 


«XH|u) 

- ■  <1  - 

tfPo 


w«  obtain 


Po) 


Po  CPoPo  **  PoP^i  ♦  (I  ~  Po)3 

log  < - > 

U  -  Po)  CPo  -  PoPo  ♦  PoP^»3 


(S-IS) 

Aaoumlng  Pot  P«  ^  Ot  tho  right  hand  aid#  tarm  ia  aqual  to 
zaro  if  tha  arguaant  of  tha  logarlthaic  function  ia  aqual  to 
It  i .a. t 


(1  -  Po)  CPo  -  PoPo  ♦  Po  P.-»3 
- -  1 


Po  CPoPo  ”  PoP^i  ♦  ( 1  “  Po) 3 


(9-lb) 


«4hich  ylsldB 


Po  CPo  -  P,-,3  -  0 


81nc«  Po  ^  Of  »«•  havi 


Po  ■  P^ 1 


(5-16-a) 


(S-17) 


Q.E.D 


Mom  ««•  show  that  tho  ROC  of  tho  optisus  dotsctor  which 
•aMiaizoB  I(H|u)  is  in  tho  shadod  araa  of  Figura  5.9»  which 
is  tha  ragion  batwaan  tha  ROC  corrasponding  to  tho  optiaua 
Bayasian  dotoction  rula  and  tha  Po  *  P^  lina. 


Wa  uso  tha  following  propart ias  of  tho  racaivor 
oparating  charactar iatic  curvas  (R^)  of  optiaua  dotactora 


1.  Tha  ROC  curvoa  for  optiaua  Bayoaian  dataction 
ayataast  lio  in  tha  araa  abova  tha  lina  Po  *  Pm*  and 


B.  Thoao  ROC  curvoa  aro  always  convax  cap. 


In  Figura  9.6t  wa  show  aoaa  typical  ROC  curvoa 
aaaociatad  with  diffarant  daciaion  rulaa  for  a  givan 


dataction  ayataa. 


Cur  VI 


( 1 )  rapraaanta  tha  ROC 


corrasponding  to  tha  optimum  dataction  rula  (using  tha 
Bayoaian  formulation).  Curva  (S)  ia  tha  invortad  ROC  CiS3t 
which  corroaponda  to  tha  worat  dataction  rula.  Tharaforo» 
tha  ROC  corrasponding  to  any  dataction  rula  for  tho  ayatam 
has  to  ba  within  tha  ragion  ancirclad  by  curvoa  (1)  and  (S). 

For  all  dataction  purpoaoBf  for  a  givan  valua  of  Prr  wa 
would  liko  to  maKimiso  tho  optimum  probability  of  dataction 


p, 


Mutual  Inforiaation  ia  a  aymmatric  function  in  its 


transition  probabilitias*  i.a.»  tha  valua  of  KHiu)  at  any 
point  At  with  coordinatas  (Pi>ttPDt)»  such  that  At  is  abova 
tha  Po  ■■  linat  is  also  achiavad  at  a  point  Ak  with 
coordinatas  ( 1-P^t » l-Pot  >  balOM  tha  Pi>  *  Ppr  linai  i.a.f 
l(PrrtPo)  •  I  <  l-P^»  l-Po) .  Tharafora*  wa  rastrict  tha  study 
to  ROC  curvas  abova  tha  Pd  ■  P^  lina*  i.a.»  tha  ROC  curvas 
lia  in  tha  shadad  ragion  of  Figura  S.S. 

ROC'S  corrasponding  to  nonoptiaum  dacision  rulas  will 
hava  all  or  a  part  of  tha  curva  balow  tha  ROC  corrasponding 
to  tha  optiaum  dacision  rula  as  shown  by  curvas  O)  and  (4). 
Tharafora*  for  any  givan  probability  of  falsa  alarM  Pp-i* 
such  that  Pfrt  €  (0|1)»  tha  corrasponding  probability  of 
dataction  on  curva  <1>»  Pott  <on  tha  optimua  ROC)  and  tha 
ona  on  curva  (4)t  Pott,  <on  a  nonoptiaum  ROC)  satisfy  tha 
following 

for  all  P»tt  such  that  P^t  €  (Ofl)*  Potn  i.  Pot*, 

Finally*  sines  l<M|u)  is  a  concava  upward  function  in  Po  for 
a  givan  valua  P^r^  of  and  tha  minimum  valua  of  l(H|u)  is 
achiavad  by  choosing  Po  *  Pp-t*  than  for  valuas  of  Po  such 
that  Po  I  Pp-tf  X(H|u)  is  an  incraasing  function  in  Po, 
Tharafora*  if  Poj  i  Po».  than  I(Ppt*Po*)  i  I(Ppt*Pow)  i.a.* 
for  a  fiKod  valua  Ppt*  tfia  corrasponding  valua  of  Po 
obtainad  using  tha  Nayman-Paarson  critarion  maKimizas 
I(H|u).  Tharafora*  tha  pair  tPo*Pp)  which  maximizas  I(H|u) 

lias  on  tha  ROC  of  tha  optimum  Bayasian  dataction  systam. 
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N«Kt»  w«  prasant  tha  aolution  to  tha  datactlon  problam 
Lising  ona  aanaor  for  tha  nlnimum  aquivocation  crltarion. 


3.5.3  Sinqla  Sanaor  Minimum  Equivocation  Dataction 


Aa  pointad  out  aarliar*  tha  claaaical  dataction 
problafliy  utilizing  a  slngla  aanaor  which  minimizaa 
aquivocation  haa  baan  aolvad  In  C59].  To  validata  our 
approachi  in  thia  aubaaction*  wa  apply  it  to  tha  aingla 
datactor  problam  and  varify  that  wa  obtain  tha  aama  raault. 
Latar  on  in  thia  chaptar»  wa  will  axtand  thia  work  to 
diatributad  multlaanaor  aituatlona. 


In  thia  problam»  glvan  tha  a  priori  probab i ! i t iaa  Po 
and  Pi »  and  tha  conditional  danaitiaa  p(y|Hj)  j^Orlr  the 
objactive  ia  to  find  tha  optimum  daciaion  rule  which 
maximizea  tha  mutual  information  l(H|u)  <or  minimira  the 
equivocation  h(H|u)). 

Me  conaidar  tha  ayatam  (channel)  ahown  in  Figure  5.5. 
Me  recall  that  tha  optimum  daciaion  rule  which  maximizea  the 
mutual  information  I(HfU)  haa  ita  operating  point  (PdiPf-)  on 
tha  ROC  of  the  optimum  Bayaaian  detector  which  ia  a 
thraahold  detector.  Thua*  tha  optimum  MED  datactor  can  be 
implamantad  aa  a  thraahold  datactor  with  the  following 


llkslihood  ratio  toot 


fi(y) 


ptyjH.)  > 

p(y|Ho>  < 


(9-18) 


Also  Po  ond  P»r  oro  givon  by 


Po  -  P(u-l|Hi)  >  I  p(Q|Ht 


>  dQ 


(9-19-0) 


Pm  •  P(u«l|Ho) 


p(fi|Ho)  dQ 


(9-19-b) 


Tho  Mutuol  inforootion  is  givon  by  (9-13) »  or  oquivalontly 


I(Hlu)  -  Po  (1  -  P*r)  log  (1  -  P^)  -  Po  (1  -  Pi-)  log  Oo 

—  (1  —  Po )  (1  —  P» )  log  do  ^  Po  Pm  log  Pm 

—  (1  — Po )  Po  log  9\  ♦  (1  —  Po)  Po  log  Po 

♦  (1  -  Po)  <1  -  Po)  log  (1  -  Po)  -  Po  P^  logoi 

(9-aO) 

Mhoro  oo  ond  Oi  oro  tho  o  postoriori  probobilitioB»  givon  in 
(9-18).  Taking  tho  dorivotivo  of  I(H|u)  Mith  roopoct  to  Pmt 


I 


S 


'  py‘. 


And  BAtting 


(S-ai) 


and  raarranging  thm  rasultf  ttm  gat 


«I(H|u)  I  - 

-  ■  -  Po  log  -  ♦CPo*t  (1-  Po>31og  Bo 

tfP-  Pw 


1  -  Po 

-  t  <1  -  Po)  log  -  CPo  ♦  t  (1  -  Po>]log 

Po 

(9-88) 


Sotting  this  dorivativo  aqual  to  sbpo  and*  solving  for  t*  ms 


-  Po  C  log(ao/Si)  -  log(  ( l-Pi»)/P*»)  3 


(1  -  Po)  C  log(ao/a*)  -  log( ( l-Po)/Po) 3 


(9-83) 


Sines  Po  and  P^  dopsnd  on  t*  ths  right  hand  Bids  is  also  a 
function  of  t.  Aftsr  solving  for  t*  Po  and  Pp^  can  bo 
obtainsd.  It  can  bs  shosn  that  ths  valus  of  t  in  (9-83)  is 
ths  sass  as  obtainsd  by  riiddlston  C893  and  Sabriolls  C373. 
NsKt*  MS  solvo  ths  MED  problos  for  ths  DDF  systss. 


Fwiigp 

In  this  ssetion*  ms  considsr  ths  binary  hypothssis 
tssting  systss  shoMn  in  Figurs  1.3.  Ws  assuas  that  ths 


obsarvAtions  at  dlffarant  datactors  ara  Indapandant.  Wa 
find  tha  optiaum  fuaion  rula  and  tha  optiaua  daclaion  rulas 


at  tha  individual  datactora 


information  I(Hlu). 


lich  aaximiza  tha  aucual 


Again  wa  aaauma  that  tha  global  daciaioni  u»  dapanda 
only  on  tha  praaant  daciaion  vactor  x  and  that  tha  daciaion 
Uk  of  datactor  i  dapanda  only  on  ita  own  obaarvation 
ial»S»...»N.  Wa  will  uaa  tha  raault  obtainad  in  Baction 
9.2*  i.a.t  Po  and  P^  for  tha  ayatam  which  aaxiaizaa  tha 
mutual  information  corraapond  to  a  point  on  tha  ROC  of  an 
optimum  ayatam  with  minimum  Bayaaian  riak  . 


Uaing  tha  raaulta  of  Baction  3.4  for  indapandant 
obaarvationof  wa  concluda  that  tha  datactora  uaad  ara 
thraahold  datactora.  Firat*  wa  aaauma  that  I<Hfu>  ia  a 
function  of  a  variabla  v»  balonging  to  an  intarval  (a>b) 
and*  wa  find  an  aquation  in  v  which  can  bo  aolvad  to  yiold 
tha  maximum  of  I<Hfu)  with  roapoct  to  v.  Than*  wa  aaauma 
that  tha  datactora  havo  alraady  boon  daaignad  and  wa  obtain 
tha  optimum  fuaion  rula  which  maximizaa  I(H|u>.  Aftor  that* 
wa  aaauma  that  tha  fuaic-n  rula  ia  known  and  wa  obtain  tha 
optimum  daciaion  rulaa  at  tha  individual  datactora  ao  aa  to 
maximizo  I<H|u).  Finally*  wo  obtain  tha  ovarall  aolution* 
i.a.*  wo  obtain  tha  optimum  fuaion  rula  and  tha  optimum 
daciaion  rulaa  at  tha  datactora  which  maximlza  Z(H|u). 


Aa  wo  mantionad  oar  liar*  bafora  wa  procaad  with  tha 
aolution  to  tha  problam*  wa  praaant  tha  following  thooram. 


vS-V 


w 

•  S  %|  ‘ 
■  *  *  • 


v\«  V 

y 


V-> 


/-.•'•.-I 


CsWj 

■m 


. , .  l 

S."  V*  *•«>.*•  ^  *  *  • 


Th»or«m  S.g 


L«t  I(H|u)  b»  th»  mutual  information  bmtwmmn  th*  random 
variablma  H  and  u.  Lmt  v  bm  a  variablm  auch  that  v  €  (a»b). 
and  I(Hfu)  *  f(v)y  (thm  mutual  information  ia  a  function  of 
v).  Tha  axtromuffi  (maximum  or  minimum)  of  I(H|u)  ia  obtainmd 
by  aolving 


I  ia  incrmaaing  in  v 

> 


tfPo 

SP^ 

Co  1  )  —  — — 

—  Po ( Coo  —  Cio)  —  *  0 

I  haa  an 

Sv 

axtramum 

< 

I  ia  dacraaaing  in  v 


(5-E4) 


P(u»  *H j ) 

C»j  ■  log  i - ) 

P(u»)  P(H,) 


i,j  ■  0,1  (S-SS) 


Proof 

Tha  mutual  information  I<H|u)  ia  givan  by  (S-4).  Tha 
logarithmic  coat  function  ia  givan  in  (9-25).  Raarrartging 
I(H|u)  and  aubatituting  C,j,  i,j  «  0,1,  into  (5-4),  wa  gat 

1 ( H I U )  •  Po  ( C 1 o  —  Coo )  P^  —Pi  ( Co 1  —  Cll)  Po  ^  Po  Coo 


PiCo 


( 9-2b ) 


L«t  V  b«  a  variabi*  such  that  v  C  (a»b)»  and  I<H|u)  la  a 


function  of  v.  Tha  valuo  of  y,  whara  tha  mutual 
information  haa  an  axtramua  (  if  tha  axtramum  axiata  and 
€(a»b>  >f  ia  obtainad  by  aatting  tha  darivativa  of  I(H|u) 
with  raapact  to  v  aqual  to  zaro.  Taking  tha  partial 
darivativa  of  I(H|u)  with  raapact  to  v  and  raarranging  tha 
raaultt  wa  gat 


““““““  ■  F(rfv)  ^  Po  (Cio  “  Coo)  “ 
tfv  6y 


tfPo 

“  P»  (Co»  “  Cl  1 )  ——— 

Sy 

(3-27) 


whara 


F<tfv)  -  Po  (  - 


SCoo 

- )  p, 

Sy 

tfCo* 


SCax 

-  Pi  ( - 

£y 


iTCii 

- )  Po 

£y 


(3-28) 


or  aquivalantly 


£Coo  SCot 

.'■(tfv)  - - C  Po  (1  -  Pi-)  3  >«■ - C  Pi  (1  -  Po)3 

£v  Sy 


£C 1 o  SC  1 1 

- Po  Pi-  - Pi  Pi 

Sy  Sy 


(3-29) 


"ii  m  »ypMHjj.w^.w7jv^v.  »■. 


But 


f  Coo 


tfpl- 

SPw 

tfPi 

6w 

"  — —  — 

tfv 

«v 

Pi 


1 

1  > 
i  •« 

1 

(1  -  P,r) 

Po 

(1  -  P,-) 

Pi  (1  -  Po) 

tfp.- 

SP,^ 

^Pd 

sc  to 

jv 

— —  ro  ^ 

Sv 

Sv 

Pi- 

Po  P-  ♦  Pi 

Po 

«Po 

tfP- 

tfPo 

SCot 

““““  Po  “ 

tfv 

n 3 

tfv 

iv 

(1  -  Po) 

Po 

(1  -  P,-) 

Pi  (1  -  Po) 

(3-30-*) 


(a-30-b) 


(3-30-c) 


•ndi 


«Cii 


tfP» 


tfPo 


Pi 


tfv  «v 

Po  P^  ♦  Pi  Pi 


(S-30-d> 


Substituting  <9-30)  into  <9-39)  and  rsarrangingi  w*  havs 


F(tfv)  -  Po  C 


o  C 

SPw 

1  ^  p  r 

tfPo 

6Po 

1 

«V 

€v 

€v 

«V 

J 

fP.- 

B  ^ 

SPt> 

Po  (1 

r  r 

-  Pi-) 

♦  P»  (1 

-  Po) 

Po  ^ 

■r'x  J 

\  L  -a-  -u  - 

Po  (1 

-  Pi-) 

♦  Pi  <1 

-  Po) 

]> 


Po  P.-  ■*■  Pi  Pi 
Po  P^  ♦  Pi  Po 

(9-31 ) 
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m 


SS5 


Aii 


* 


:jL2 


■  a^*a 


J?l?3 


>  ■>  * 


•VV»i 


‘rf-s*" 


'.\N  >1 

n 


S\y, 

•.%  .V' 

••’•'a** 


I 


tfKHIu) 


which  !■  aqual  to  z«ro.  Th»n»  -  bocomos 

«v 


Sv 


Po  ( C 1 o 


Coo  ) 


tfP- 


Sv 


SPo 

Pi  (  Co.  -Cl.)  - 

Sw 

(9-3a-a) 


or 


tfKHiu)  tfPo 

■  —  ■  Pj  (Cl.  —  Co.)  « —  — •  —  Po  t  Coo  — C  1  o )  — — — 

Sv  tfv  tfv 

(S-32-b> 


But*  th«  following  is  alwayo  tru* 

l(H|u)  is  on  incroaaing  function  in  v 
«I(H|u)  > 

-  .  O  I(H|u>  h««  an  •xtromuin 

tfv  < 

I<H|u)  ia  a  docra««ing  function  in  v 

(S-33) 

and  thua*  wo  havo  tho  doairod  roault. 

Q.E.D. 

Now*  wo  procood  with  tho  aolution  to  tho  problom. 

Firot*  wo  oolvo  for  tho  optiaum  fuaion  rulo. 

Ootiwum  Fuaion  Rulo 

Figuro  1.3  ahowo  tho  oyatoo  undor  conaidoration.  Wo 
aaaumo  that  tho  dotoctoro  havo  alroady  boon  doaignod.  Wa 


furthar  •■■uma  that  tha  final  daciaionp  u»  dapanda  on  tha 


dacision  vactor  k  and  not  on  tha  obaarvationa.  Tha 


objactiva  ia  to  obtain  tha  fuaion  rula*  i.a.»  find  Pax*»  tha 


probability  of  daciding  u  ■  1*  Mhan  tha  praaant  daciaion 


vactor  ia  k*  *  t  •  •  •  a  apacific  valua  of  x, 


Racall  that  tha  probability  of  dataction  Pd»  and  tha 


probability  of  falaa  alarm  P^  ara  givan  by 


Po  “  £  P»x  P> 


Z  Pi, 


(S-34) 


Lat  tha  variabla  v*  dafinad  aarliar»  ba  tha  probability 


PiK*y  and  <a»b)  ba  tha  intarval  (0»1).  Than*  (5-3S>  bacomaa 


tfl(Hfu) 


(5-35) 


Bubatituting  from  (5-34)  into  (5-35) »  wa  hava 


tfl(Hlu) 

"Pi  (Cia  —  Coi  )  P|l*»  ”  Po  (Coo  —Cao)  P>€*o 

tfPax* 

(5-36) 


Nhich  ia  in  ganaral  non  zaro.  Thua»  »«a  hava  tha  follOMing 


daciaion  rula 


Sat  Pa«*  •  1 


Pa  (C, 


Coa)  PK*a  -  Po  (Coo  -Cao)  Pi.*o  0 

< 


Sat  PaK-  -  o 


(5-37) 


w 


.  V  V  V 


Hm  that 


Coo  —  Cta 


(5-38-a) 


Cl,  >  C< 


which  is  squivalant  to 


P(u«i IHi) 

log - i  0 

P(u-i |Hj) 


(5-38-b) 


(S-39-s) 


i^-j.  i.j  -  0.1 


P(u-1 |Hi) 
P(u»i jH,) 


(5-39-b) 


Thsrsfors. 


P<u«l|x*)  ■  1 
Pk*,  y  Po  ic< 


“  Cio) 


P 1  ( C 1 1  —  Coi ) 


(3-40) 


P(u-1|K-)  - 


Nsxt.  MS  find  ths  optiMMi  dacision  ruiss  st  ths 


dstsctors. 


Qptiaus  Dacision  Ruiss  st  Ths  Pstsctors 


Wa  again  considar  tha  systaa  shown  in  Figura  1.3.  Wa 
assuaa  that  tha  fMsion  rula  is  known  and  wa  find  ths 


rwrwn 


d«ci»ion  rul««  mt  th«  Individual  d«t*ctor«.  Uhila  deriving 
tha  dacision  rula  at  datactor  H»  H  *  wa  aaauaa 
that  othar  datactora  hava  alraady  baan  daaignad.  Using  tha 
saaa  approach  uaad  in  finding  tha  fusion  rula  and*  satting 
V  ■  Pi>H  and  (a»b)  >  (0»l)f  tha  darivativa  of  I(H|u)  with 
raspact  to  is  givan  by 


«I(H|u)  6Pt> 

_______  ■  Pj  (Cii  “  Coi )  — — — — 


Using  tha  chain  rula*  wa  hava 


“  Po  (Coo  “  Cio) 


<S-4l) 


(5-42) 


whara  wa  hava  usad  tha  rasult  obtainad  praviously*  i.a.*  tha 
datactors  ara  thrashold  datactora  and  tha  fact  that 


SPoh/ SPr 


Substituting  (5-42)  into  (5-41)  »  wa  hava 


«I(H|u)  «Pi> 

-  •  Pj  <c»,  -  Co.)  -  tn  -  Po  (Coo 

tfP^H  tfPoH 


-  C.o)  - 


(5-43) 


Satting  (5-43)  aqual  to  zaro  and  solving  for  tn*  wa 


Po  (C.o  —  Coo )  — • 


iPw^ 


t-  - 


(5-44) 


P.  (Co.  —  C. .  )  — 


A«  •xpactad*  tha  axpraaBion  of  tn  obtoinad  hara  haa  tha 


aama  form  aa  tha  ona  wa  found  in  tha  Bayaalan  caaa»  axcapt 


that  hara  Ctj  itj  *Otl  ara  not  conatanta.  Wa  gat  N 


coupladt  nonlinaar  aquationa*  Mhich  aould  ba  aolvad 


aiaultanaoualy  to  ylald  tha  daairad  raault. 


Tha  ovarall  aolution  to  tha  problam*  i.a.»  finding  tha 


optimum  daciaion  rulaa  at  tha  individual  datactora  and  tha 


optimum  fuaion  rula  which  maximiza  I(H|u)  (or  minimiza 


h(H|u))  can  ba  obtainad  by  aolving  S'^  aquationa  of  tha  form 


(9-40)  and  N  aquationa  of  tha  form  (9-44) »  aimultanaoualy . 


Many  aolutiona  may  raault.  Only  tha  onaa  which  corraapond 


to  tha  abaoluta  maximum  of  I(H|u)  (or  minimum  of  h(H|u>)  arm 


to  bo  kopt. 


S •  ^  PigtribwLtiid  Hinlmum  Equivocation  Dataction 


9.4.1  Introduction 


In  thia  aoction*  wa  find  tha  optimum  daciaion  rulaa  at 


tha  individual  datactora  which  maximiza  tha  mutual 


information*  I(H|x)t  for  tha  ayatam  ahown  in  Figuro  9.7. 


Tha  binary  hypothoaia  taating  problam  ia  conaidorad  and*  tha 


obaorvationa  at  tha  individual  datactora  ara  aaaumad  to  bo 


i ndapondant  i . a . 


p(Y|H,)  -  ||^p(y.|HW 


(9-49) 


s 


Wla  racall  that  in  this  caaat  k  ia  tha  daciaion  vactor  and  la 
givan  by  k  ■  (u<  »uaf . . .  whara  Un  ia  tha  daciaion  of 
datactor  i*  i«l»Si...»N»  and  tha  daciaion  of  aach  datactor 
only  dapanda  on  ita  own  obaarvation. 


Firati  wa  will  ahoN  that»  aach  datactor  ahould  uaa  a 
likalihood  ratio  taat  (thraahold  datactor).  Than*  wa  will 
dariva  tha  aKpraaaiona  which  yiald  tha  optiaum  thraahold  at 
tha  individual  datactor.  Latar  on  in  thia  aaction*  wa  will 
praaant  a  auboptiaua  aolution  to  tha  problam  conaidarad  in 
Saction  9.3.  In  tha  auboptimum  aolution*  wa  will  aolva  tha 
problaa  of  optimizing  tha  mutual  information  in  two  aaparata 
atagaa*  i.a.*  in  tha  firat  ataga*  wa  maMimiza  l(H|x)  and 
than  in  tha  aacond  ataga*  wa  maximiza  I(xtu>. 


Naxt*  wa  will  ahow  that  for  tha  dataction  ayatam  ahown 
in  Figura  9.7  with  multipla  aanaora  and  minimum  aquivocation 
critarion*  tha  datactora  ara  thraahold  datactora.  Bafora  wa 
conaidar  tha  ganaral  caaa  of  N  datactora  (N  >  S)  *  wa 
conaidar  tha  caaa  of  two  datactora. 


Two-Datactor  Caaa 


In  thia  caaa*  wa  uaa  an  approach  aimilar  to  tha  ona 
uaad  in  tha  pravioua  aaction.  Firat*  wa  ahow  that  if  Pr^i* 
P*'«  and  Pow  ara  givan*  tha  valua  of  Po*  which  minimi zaa 
I(H|x)  ia  aqual  to  Pw\.  Than*  wa  uaa  tha  convaxity  property 
of  I(H|x)  to  ahow  that  tha  pair  (P*'**Pi>*)*  i  ■  1*8*  which 
maxifflizaa  I(H|x)  ia  a  point  on  t)ia  racalvar  oparating 


ch«ract«ristic  curv*  <ROC)  of  tho  optimuo  thrashold 
d«t«ctor»  using  ths  Bsyssisn  formulstion.  Thsn»  ws  find  ths 
thrssholds  which  •sximizs 


Considsr  ths  chsnnsl  sodsl  shown  in  Figurs  3.B.  Ths 
transition  probsbi 1 i tiss  srs 


PiUi*l  fUw**!  |Ho)  •  P^»  Pwm 


( 1 

-  Paa)  (1  -  Paa) 

(3-46-s) 

( 1 

“■  Poa)  (1  “  Poa) 

(3-46-b) 

( 1 

“  Paa)  Paa 

( S-46-C ) 

( i 

—  Poa )  Poa 

(3-46-d) 

Pa  a 

U  -  Paa) 

(5-46-s) 

Poa 

(1  “  Poa) 

(S-46-f ) 

Pa  a 

Paa 

(5-46-g) 

and* 


P ( U »■ 1 » U«* 1 j H » )  •  Po»  Poa 


(S-46-h) 


Ths  output  probabilitiss  P(x  *  00)t  P<k  >  01 ) »  Pig  •*  IQ)  and 
P(x  >  11)  ars  dsnotsd  by  soo#  «oa »  «ao  and  aaa  rsspsctivsly . 
Thoy  ars  givan  by 


Oloo  -  Po  <1-  Pa-aXl  -  P^m)  ♦  <1  “  PoMl  -  Poa  )<  1  -  Po«> 

(S-47-a) 

Wo  a  ■  Po  (I  ~  Pa  a  )  Paa  (  1  —  Po)  (1  “  Poa  )  Poa 

(3-47-b) 


Oio  ■  Po  P^»  (I  ”  Pf**)  * 


Po)  Poi 


(1 


Poa  ) 


dxi  ■  Po  Pt»»  P^a  *  (1  “  Po)  Pot  Pi 


The  joint  probabl litioB  aro 


P<UiB0iUa*0|Ho)  ■  Poi  1  “■  P^i)  il  ■”  P^a) 


<a-47~c) 


( S-47-d ) 


(9-48-a) 


PiUt->0»Ua*0»Hi  )  a  (1  -  Po)il  -  Pot)  <1  “  Poa)  (5-48-b) 


PiUiaOiUa*! pHo)  ■  Po  <1  -  Pat)  Paa 


P<Up>OpUaal pHt )  *  (1  -  Po)  (1  -  Pot)  Poe 


P  i  U  t  a  1  *  Ua*0  p  Ho  )  “  Po  Pat  il  "■  Paa  ) 


PiUt*ltUa«OpHt )  a  (1  -  Po)  Pot  il  “  Poe) 


P i Uial  p Uaal  p Ho  )  “  Po  Pat  P«* 


i5-48-c) 


i5-48-d) 


i5-48-«) 


(5-48-f ) 


i 9-48-8 ) 


andp 


PiUtal pUaal pHt )  ■  il  ”Po)  Pot  Pi 


i5-4B-h) 


whar*  again  Po  and  Pt  ara  tha  a  priori  probabi 1 itiaap  and 
Pat  and  Pot  ara  tha  probability  of  falaa  alarm  and  tha 
probability  of  dataction  of  datactor  ip  1  ■  l»2. 
Subatituting  i9-46)p  i9-47)  and  (9-48)  into  i9-4)p  liHlx) 


I 


m 


i 


b»COffl«B 


\ 

I 

i 


I(H|x>  -  -Po  C  log{Po>  Pf'mPi'.logCPoPi'>Pi'.> 


♦  ( 1-P,-.  )  ( l-Pi-«>  log<Po(  1-P.-I )  <  l-P,-«)  > 


*  ( 1“P^» )P^»logtPo( 1“P^» )P^»J 


+  P,-t<l-P.-«)log<PoPf-»(l-Pi-«>>  3 


+  <l-Po>  C  (l-PD»><l-Po«)logCa-Po>(l-Poi)(l-Po»>> 


*  (1  “Po»  )  Pt>m  1  Og  {  (  1  “Po  )  (  1  “Pi>  t  )  Pi>«  3 


*  Poi ( l“Po« ) logC ( l“Po )Po» ( l“Po« ) 3 


^  Pi>» Pf>«logC  ( l“Po ) Poi Po« 3“  1  og{  ( 1  “Po )  3  3 


~  C Qioo  1  og Cotoo 3  *  do  1 1  og C oio I  3  *  o(iologCo(to3 


I 


di  a  logCdia3  3 

(5-49) 

Taking  th«  ddrivativ*  of  Z<H|x)  Mith  raapact  to  Pr^i*  h*  gat 


f 

V 
> 

V 


tfZ(Hlx)  1  “  P..*  doo 

■  “  Po  logC  — — — —  j  ♦  Pj,  (1  —  p^s)  log  — — — 

rfP^a  P»^i  do  a 


Po  P^«  log 


dao 


da  a 


( 5“S0 ) 


•b.  .  V 


datactor  and  In  tha  caaa  of  indapandant  obaarvationa  tha 
datactora  would  bo  throahold  datoctora. 


9 . 4 . S  Qotiaum  DP  Syatam 


In  thia  aubaaction*  wo  find  tha  thraaholda  which 
maximizo  l(Hlx)  for  tha  DD  ayataa  ahown  in  Figuro  9.6. 


Wo  racall  that  for  tha  throahold  datactora*  tha 
probability  of  dotoction  Po*  and  tha  probability  of  falaa 
alarm  P^k  i«l»2»...«N  ara  raapactivaly  givon  by 


Pok  -  I  p(Qk|Hk)  dOk 


i  -  . . N 


(9-g2-a) 


and* 


Vk  -  I  p<Qk|H 


o)  dClk 


i  *  1*2*. ..pN 


(9-92-b) 


whoro  tk  ia  tha  throahold  of  datactor  i  and  fik  ia  tha 
likolihood  ratio  dofinad  aa 


fik(yk>  ■ 


p<yk |Hk) 


i  *  1*2*. ..*N 


(9-93) 


For  oach  datactor  tha  likolihood  ratio  taat  ia  tha  following 


jfkVi 

■ 

vV.i.' 

W' 


.J.S  W 


■^v 


■  »  *  M  ■  -  •  .  r  .  »  _  ■  ,  •  «  •  •••  ^  »*•"*.**•  fc*  »  •.  ' 


< 


i  - 


(3-54) 


•nd» 


t»  ■ 


i  -  . . N 


(3-33) 


Two  J^.t9s.(^r_ JCuie 


In  this 


»  I(H|x)  is  givsn  by  (3-49).  Taking  tho 


darivstiva  of  l(H|x)  with  raspact  to  P**!*  wa  hava 


«I(H|x) 


1  -  P, 


-  Po  log< 


I  -  P. 


-  (I  -  Po) 


logC 


’C  Soo  log  Soo  *  Sao  log  Sao 


Soa  log  aoa  aaa  log  Oaa  3 

(3-36) 


Raarranging  (3-36) a  matting  tha  raault  aqual  to  zaro  and 
solving  for  taa  wa  gat 


I 


ttoa  Olio 


1  -  P,^. 


Cloo 

Po  CloQ< - }  Pr«log< - >  -  logC - >D 

Olio  Oloo  01 1  1  P^i 

ti  ■  - - * - 

0U>o  Oloi  Olio  1  “  Poi 

(l-Po>Clog< - >  ♦  Po.log< - >  -  log< - >3 

Olio  Oloo  Olii  Pdi 


(S-57-«) 


Similarly. 


®oo  Oloi  Olio  1  “  P^» 

Po  ClogC - }  P^ilog< - >  -  logC - >3 

Oloi  ttoo  Oil  Pr'-K 

Oloo  Ooi  Oio  1  ~  Pt>K 

(l-Po)Clog< - >  ♦  PoilogC - >  -  logC - >3 

Ooi  Ooo  Oil  Pi>« 


( 5-57-b ) 


Solving  (S**97~a>  and  (9-S7-b>  aimultanaoualy  yields  tha 
optimum  thresholds  which  maximize  the  mutual  information. 

Three  Detect or  Case 


In  the 
procedure. 


case  of  3  detectors,  we  may  use  the  same 
Defining  Ok  ■  Ouiusus  as  the  probability  of  the 


output  vector  x  ■  (ui  .u«.ua)'^.  the  expression  of  ti  is  then. 
Po  K 1 

ti  -  -  ( - )  ( - )  <9-98-a) 

I  -  Po  K. 
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1  •  P^l  ttooo 

K»  -  log  ( - )  -  (1  -  PraXl  -  Pm)  log - 

P^ I  ®  »  oo 


OooA  do to 

-  (1  -  Pm)  Pm  log - ♦  Pm  <1  “  Pm)  log - 

dtot  dtto 


dot  t 

P^«  P^»  log  - 

dt  1 1 


(5-58-b) 


and* 


1  —  Pot  dooo 

log  (—————)  —  (1  —  Po*)  i  1  “  Po»)  log  — — 

Pot  dtoo 

doot  dolo 

“  X  ”  Pdb )  Po»  log  — —  ♦  Pd*  tl  ”  P»»)  log  — — 

dtot  dt  to 


dot  t 

—  PoK  Poo  log  ——— — 

dt  1 1 


(S-5B-C) 


Similar  axprdBaiona  ara  availabld  for  tm  and  t*.  Solving 
tha  raaulting  thraa  aquations  aimultanaoualy  yialda  tha 
optimum  solution. 


In  a  similar  mannar*  for  tha  casa  of  N  datactors  shown 
in  Figura  3.7,  wa  gat  tha  following  aKprassion  for  tha 


thrashold  of  tha  datactort  H  ■ 


1  “ 

Po  C  log  i - > 

P.-.. 


HO  HI 


-  £  Fk  log  i  ax.  /  >3 


1  “  PoH  H  HO  HX 

<l-Po)  C  log  i - >  -  £  Djl  log  <  Ok  /««  >3 

PoH  * 


(3-59) 


whara  Fk  «nd  Dx  ara  dafinad  in  (S-11)  and  £  ia  the 


Bummation  ovar  all  posaibla  dacision  vactors  x.  Tharafore* 


wa  hava  N  nonlinaar  couplad  aquations.  Solving  thasa 


aquations  simultanaously  yields  the  optimum  solution*  i.a.* 


optimum  decision  rules  at  the  detectors  to  maximize  I(H|x) 


(or  minimize  the  equivocation  h(H|x).  Wa  may  gat  many 


solutions*  only  the  feasible  solutions  are  to  bo  kept. 


3.4.3  Buboptimum  Solution  for  the  DDF  system 


When  wa  considorod  the  DDF  system  with  N  sensors  in 


Section  3.3*  wo  concluded  that  a  simultaneous  solution  of 


N  8^  couplad  nonlinaar  aquations  is  required.  This  is  a 


difficult  task  especially  whan  N  becomes  large.  In  this 


section  wo  consider  a  suboptimum  solution  where  we  optimize 


the  system  in  two  stages  *  i.e.*  first  we  maximize  I(H|x) 


and  then*  maximize  I(x|u) 


Maximization  of  I(H|x)  has  already  been  considered  in 


Section  3.4.S.  While  maximizing  I(x|u)*  we  assume  that  the 


detectors  have  already  been 


designed*  i.e.»  the 


1 


J 


ts. 


'8 


I  ‘  aji  *  Ai*  ^  A^  *  kJI  ^1 


probability  of  k  ■  . . .  la  knonn  for  all  x  which 

makaa  h(x)  a  constant.  Ua  wish  to  maximlza  l(x»u)  (or 
mlnlmiza  h(x|u))  for  tha  ayatam  shown  In  Flgura  9.9,  Mo  uaa 
the  following  axpreasions  of  l(xtu)  and  h(2<|u) 


l(x|u)  ■  h(x)  h(u)  -  h(x»u> 


(5-60-a) 


h(x|u)  *  h(xtu)  -  h(u) 


(9-60-b) 


Minimizing  tha  equivocation  la  equivalent  to 
simultaneously  minimizing  h(x»u)  and  maximizing  h(u>f  if 
possible.  Me  recall  that  hCxfU)  is  a  convex  downward  (cap) 
function  in  P(x»u).  Thusi  for  a  given  value  of  P(x)  the 
absolute  minimum  for  h(XfU)  is  achieved  by  setting  P(u|x>  to 
be  either  "0"  or  "1".  A  corresponding  maximum  of  h(u)  is 
possible  by  choosing  the  values  of  P(u|x>  which  set  P(ubO) 
and  P(u*l)  as  close  as  possible  to  l/£*  because  the  absolute 
maximum  of  h(u)  is  1  for  P(u>=0)  ■  P(u=l>  «  l/S.  Note  that 
it  is  desirable  to  set  u  <■  0  whan  x  *  (0t...t0>'^  and  u  ■  1 
when  x*  (1»...»1)"^. 


Let  us  consider  tha  question  if  it  is  possible  that  the 
maximum  value  of  I(x|u)  (or  minimum  value  of  h(x|u))  is 
achieved  at  points  whore  P(u|x>  are  not  set  to  be  O's  or 
I’s,  e.g.  by  sotting  P(u)  such  that  P(u*0)  ■  P(u»l)  “  1/2 
which  maximizes  h(u)i  and  set  P(u|x)  accordingly*  or  any 
other  possible  combination.  In  answering  this*  wo  refer  to 
the  fact  that  since  h(x|u)  is  convex  downward  function  in 


^  •*  *•  -*  -•  ••  --  * 


th«  transition  probabi 1 iti««»  it  haa  to  achiava  ita  maximum 
at  a  point  whara  tha  transition  probabi 1 i t iaa  form  a 
combination  of  **0*0“  and  "I’s”.  Tharafora*  P(u|jj)  can  taka 
tha  valuas  zaro  or  ona  only*  (for  all  posaibla  combinations* 
(0*1)  h(%*u)  is  tha  aama). 

9 . 9  NymgriCgl  iygltpJ  M 

Exampla  9.1 

In  this  axampla*  Ma  conaidar  tha  aama  syatam  as 
considarad  in  tha  axampla  of  Saction  3.S.  Tha  syatam  has 
two  datactors  with  indapandant  obsarvationa  givan  by  (3-88). 
Wa  will  daaign  tha  syatam  (both  DD  and  DDF)  so  aa  to  minimza 
tha  aquivocation  batwaan  tha  input  and  tha  output. 

Racall  that  in  thia  caaa*  tha  datactors  aro  throahold 
datactors.  In  Figura  9.10*  wa  praaant  tha  ROC  curva  for 
this  axampla  (DDF  syatam)  whan  O*  »  S  and  Oa  *  4.  Again*  in 
this  caaa  tha  "OR"  fusion  rula  is  auparior  to  tha  "AND" 
fusion  rula.  Wa  also  show  tha  curva  of  I(H|u)  varaua  Po  in 
Figura  9.11.  Figura  5. IS  shows  tha  curvas  of  t* ’  and  ta’ 
varaua  Po*  whara  t*'*  i  ■  1*8*  is  tha  valua  of  tha  thraahold 
at  datactor  i*  1*8  aa  dafinad  (3-90). 

For  tha  DD  configuration*  whan  (0i*0a)  *  (8*4)*  tha 
curva  of  I(Htx)  varaua  Po  is  shown  in  Figura  9.13.  Tha 
curvas  of  t*’  and  tm’  ara  shown  in  Figura  9.14.  Whan 
(8**8«)  ■  (3*6)*  tha  curvas  of  ti’  and  ta’  ara  shown  in 


Figure  5.14  t'|  nnd  Versus  for  Example  5.1  ami 


( ^  'O 


(I)D  (auif  I  gur.it  Ion) 
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V'yy.' 


Figur*  S. 15 


Whan  (ei.ee) 


(S.S).  tha  curva  of  I(H(x) 


varaua  Po  la  shown  In  Figura  S.16  and  tha  curvaa  of  t»’  and 


te'  ara  shown  in  Figura  S.17. 


For  tha  ona-sansor  casa  and  e  “  S»  tha  curva  of  I(Hlu) 


is  shown  in  Figura  5.18  and  tha  curva  of  t'  is  shown  in 


Figura  5.19. 


EKamp la  5.5 


Now.  lat  us  assuma  that  it  is  dasirad  to  maKimiza 


Kxtu).  for  tha  systam  shown  in  Figura  5.9.  Wa  ara  giv^n 


tha  following  probabi 1 i tias 


5  1  1 

P(Ui«0.U»*0)  “  — .  P(Ui“O.Ue*l)  «  - .  P(Ui“l»Ue*0)  *  - 

5  15  5 


P  (  U 1  ••  1  »  Ue*  I  ) 


Wa  maximiza  tha  mutual  information  I(x(u>  by  satting 


tha  following  probabi 1 1 tias  which  sat  tha  output 


probabi 1 itias  closa  to  1/S 


1.  Posti  “  1»  Poxo  •  0  and.  Pom^  “  0 


Ihis  impllas  that 


»>>.• 

Si^yC>j 


rvVjN 


k  *  k  • 

.■'MV 


f  V  f 


'  ‘*** 


CrlTf^l 


P(u-O)  >  14/30 


•ndf 


P<u-1)  -  16/30 


Thsraforat  th«  maximufflp  of  I(x|u)  !• 


(7/15)  In  «15/7>  ♦  (8/15)  In  {15/B>  -  0.69, 


In  thim  •xanplop  m«  hav*  illuatratad  tha  optimization 
procmdurm  outlinmd  in  tha  pravioua  aaction.  Am  axpactad  tha 
procadura  yialda  tha  maximum  mutual  information. 


»S 


SSSSSS8S 


Cjabinlng 


6.S.1 


In  this  ■•ctlonf  w«  considar  tha  Bayaaian  DP£F  problaai 
Hhara  tha  objactlva  ia  to  aatiaata  a  random  paraaatar  "a” 
with  a  knoMn  danaity  function  p(a).  Tha  paraaatar  a  la 
dafinad  on  aagaanta  of  tha  raal  lina.  Wa  conaldar  tha 
ayataa  ahown  in  Figura  6.1.  Each  local  aatlaator  racalvaa  a 
oat  of  oboar vat Iona  danotad  by  an  oboarvation  vactor. 

1  *  l»2f...>Np 

Mhara  n  la  tha  nuabar  of  obaarvatlona  at  aach  aatlaator  and 
N  la  tha  nuabar  of  local  aotiaatora.  Than*  baoad  on  Ito 
oboarvation  vactor*  y*  *  tha  1**^  local  aatlaator  aatlaataa 
tha  paraaatar  a*  by  aoolgning  a  point*  S*  ■  h*(y*)  in  tha 
paraaatar  apaca.  Tha  aatiaata  coabinar  at  tha  data  fuaion 
cantar  collacto  tha  aatlaataa  froa  tha  individual  (local) 
aotiaatora  and  ganaratao  a  global  aatiaata  S*  of  tha 
paraaatar  a.  Thio  global  aatiaata  1  dapando  only  on  tha 
aatiaata  vactor  h  ■  (h*  (y*  )  *ha(y«>  * . .  .  *ht>4(yN) 

Tha  goal  of  thio  oaction  io  to  davalop  Bayaaian 
aotiaation  thaory  for  tha  DPEF  ayataa*  i.a.*  daoign  both  tha 
optimal  combining  rula  and  tha  aotiaation  rulao  for  tha 
local  aotiaatora  ao  ao  to  ainiaiza  tha  Bayaaian  riak*  R* 
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giv«n  by 


R  -  ECC(«»i)> 


(6-1 ) 


Hh«r« 


C(«iS)  is  ths  cost  of  sstifflsting  s  ss  1. 


Ths  risk  R  msy  also  bs  writtan  ss 


n  -  [  d.[ 


dY  C ( s •  S ( h  t  ( y t  )  tbs (ya)  *  •  •  •  yix )  )  p(StY) 


(6-3) 


whsri 


p(StY)  is  tbe  joint  density  function  of  tbs  parameter  a 
and  tbe  observation  vector  Y. 


Tbe  cost  functions  that  wo  will  consider  in  this 
chapter  will  be  functions  of  tbe  errort  ac(Y)  defined  by 


ic  (Y) 


a-i.  Three  different  cost  criteria  will  be 


considered.  Tbe  first  one  is  minimum  mean-square-error 
(MMSE)  where 


C(ac)-(a-S)' 


(6-3-a) 


Tbs  second  one  is  the  minimum  absolute  error  criteriont 


where 


C(ac)  -  le-Sj 


(6-3-b) 


Finally*  w«  will  conaidar  tha  uniform  coat  critarion*  whara 


if  |ac|  1  T 


C(a«)  - 


(6-3-c) 


and*  T  ia  a  auitably  amall  intarval 


Tha  riak  function  can  ba  axpraaaad  aa 


"  *  1  I 


dY  CCa-a(Y)3  p<a,Y) 


(6-4) 


I“I 


dh  CCa-a(h>l  p<a*h> 


(6-3) 


Tha  objactiva  ia  to  obtain  tha  aolution  to  tha  DPEF 
problaffl  ao  aa  to  minimiza  R.  Ma  obtain  tha  combining  rula 
X  *  fK(h)  and*  tha  aatimation  rulaa  hi(yi>  for  aach 
aatimator  i*  i  ■>  1*S*...*N*  ao  ao  to  minimiza  R  whan  t)ia 
coot  function  ia  ona  of  tha  functiono  diocuoaad  abova.  Naxt. 
wa  procaad  with  tha  aolution  for  aach  of  tha  coot  function*. 


p.  K  .  .  . . 


,<  u.'V. » ■  ..■  k.1  J.i  I' I  iji  .1  III  .  u 


6.2.2  riij} tjBiA .ilMn-.Sa«Ar*rEr r p.r_Cri  t «r is n 


i'' 

b 

ri 


Thmorfun  jktS 

Giv»n  th«  probability  danslty  p(a>  of  a  random 
paramotor  a»  tho  optimum  OPEP  systam  which  minimizaa  tha 
HnSEf  i.a.i  tha  optimum  combining  rula  and  tha  optimum 
aatimation  rulaa  at  tha  local  astimatorai  ia  obtainad  by 
aolving  tha  following  aquationa  aimultanaoualy . 


S».(h) 


I 


a  p ( a  I h)  da 


(6-6) 


and) 


Si 

EC (a. - 


Si 

y»3  -  EC(2. - ) 

1 


.^3 


l-l,2,...,N  (6-7) 


whara 


2na  >  tha  minimum  maan  aquara  arror  aatimata. 


Proaf 


Tha  risk  function  for  thia  problam  ia 


I“l 


dY  Ca-a(h(Y))3*  p(a,Y> 


(6-8) 


jT* 


>  V 


•V*  ,  A. 
1*.  •  . ' 


%  , 


vS! 


- 


>v 


V-J 


which  may  bo  writtan  am  a  function  of  tho  local  aatimataa* 


Si  “  i  •  l»a.«iNi 


I"*  I 


db  Ca-S(b>]*  P(a»b> 


(6-9) 


ContbininQ  Rul»  (S(h)) 


Whila  darivlng  t(h)»  na  asauma  that  tha  local 
aatlfflatlon  rulas«  a^  -  I  -  1»2*...*N»  ara  known. 
Tha  Joint  danaity  function  of  a  and  h  may  be  writ tan  aa 


p(ath)  ■>  p(b).p(a|h) 


(6-10) 


Uaing  (6-10)  f  (Vta  becomaa 


i.  -  dh  p(h)  da  Ca-l(h)}*^  p(a|h) 


(6-11 ) 


Sinca  tha  innar  intagral  and  p(h)  are  nonnegativei 
minimizing  tha  innar  intagral  for  any  valua  of  h>  minimizes 
Rns.  We  denote  tha  minimum  mean  aquara  error  eatimatei  by 
Sna(h).  NaKtf  wa  will  ahow  that  Snslb)  is  given  by 


Si>«a(h)  ■  da  a  p(a|b) 


(6-lS) 


which  is  the  conditional  mean  of  a  given  b> 


s' 


i.V/vN 

CvO-.'v 


Taking  tha  darlvatlva  of  tha  Innar  intagral  of  (6-11 )» 


'.>7/1 


wa  gat 


^  f 

-  da  Ca  -  «(h)]=  p(a|h)  -  -a  a  p(a|h)  da 

tfS(h)  J 


-«-£  2(h)  p(a|h>  da 


(6-13) 


Sattlng  tha  rasult  In  (6-13)  aqual  to  zaro  and  uaing 


p ( a  I h)  da  =  1 


wa  obtain  tha  raault  givan  in  (6-13).  Nota  that  thia 
corraaponda  to  a  minimum  (not  a  maximum),  bacauaa  tha  a*^** 
darlvatlva  la  aqual  to  3. 


•Cn'K 

/N*V" 


•".'•“."A 

m 

^  VS  aN 


TT  ar^. 

a;-'- 

s^V  ^ 

K’^'' 


Naxt,  wa  aolva  for  tha  aatlmatlon  rula,  at  tha  local 
aatlmatora. 


Local  Eat ijria 1 1  on  Ru  1  aa 


Now,  wa  aaauma  that  tha  combining  rula  la  known  and,  wa 
obtain  tha  optimum  aatlmatlon  rulaa  hi(y:i)  i  »  1, £,..., N  at 
tha  local  aatlmatora  ao  aa  to  minimlza  FUa.  While  deriving 
tha  local  aatlmata  at  aatlmator  1,  1  *  l,a,...,N,  wa  aaaume 


>>.  v -v..\ 


that  all  othar  astiaators  hava  alraady  baan  daaignad*  l.a.» 


Sj  ■  hj(y4)f  i  ^  ji  j  ■  lf2f...tNf  ara  known. 


Tha  Joint  probability  dansity  of  a  and  y  may  bo  axpraaaad 


p(aiy  >  p(yk)  p(a»yi  tym* . . .  lyi-i f  •  •  •  »yM| yi  > 


Substituting  from  <6-19)*  into  <6-8>»  wo  hava 


*‘m  4-® 

Rm.  -  I  dyip<yi)  I  da  |dY‘  Ca-X(hx (yi > »h.( y. ) . . . 


.hM(y^*>>3■  p<a,Y‘|yi> 


whara 


Y‘«  (y»'*'»  . . .  »yi-»‘*'»yi*»'^» . . .  tyN"^) 


(6-17) 


dY^  is  tha  intogral  ovar  all  alamants  of  Y^ 


(6-lB) 


-  f  daf  dY‘  Ca- 


l(h)3*  p(a,Y‘  yi) 


(6-19) 


i 


In  (6-16) •  it  im  obvious  that  p(^i>  and  Ii  ars  nonnsgative. 
Thorofora*  minimizing  thm  inner  intsgral  I&  with  rsspmct  to 


ai  minimizms  Rm«.  Taking  thm  dmrivativm  of  I i  with  rmspect 
to  m%.  and  smtting  it  oqual  to  zmroi  wa  hava 


■•••  -i-t 


f a^  ^a 1 ( y» ) 


S 

-  da 

^3 1 ( Yk )  J  I 


dy*Ca-S(Si  ,S.>  .  .  .»Sr4>3*‘p(a,Y^|  Yi 


«  O  ( 6-ao ) 

Intarchanging  tha  two  oparationst  namaly  diffarantiation 
with  raspact  to  3i«  and  integration  over  a  and  »  (6-20) 
bacomas 


I  p 

-  dY‘ 

V  1 


da  p(a,Y‘lyi) - <.  Ca-S(Sx  ,S.,  . .  .  ,5m)  > 

^5i 


•-  >•.  ■ 


VWViw' 


QyjRTAll  JULLulLon 


Thv  ovarall  Bolution  to  this  problam  ia  obtainad  by 
solving  (6-12)  and  (6-22)  slmultanaously f  which  is  tha 
das i rad  rasult. 

Q.E.D. 


Soacial  Casa  of  Two  Estimators 


In  tha  casa  whara  tha  systam  has  only  two  local 
istimatorsf  tha  aquations  to  ba  solvad  ara 


<rs 

6Z 

— ) 

yi3  *  EC(a. — 

<rs 

( 6-23 ) 


ECa. - ) I yel  -  EC (i. - ) |y»3 

iSTae  I  I 


(6-24) 


ECa I  2 1 F  ael 


(6-25) 


Solving  (6-23) «  (6-24)  and  (6-25)  sifflultanaously •  yialds  tha 
optimum  solution.  Thasa  aquations  ara  complicatad  to  solva 
dua  to  tha  coupling  and  nonlinaaritias.  Latar  in  Saction 
5.3f  wa  solva  tha  problam  whan  tha  combining  rula  is  linaar. 


Naxtt  wa  solva  tha  problam  for  tha  absoluta  arror 
cr itar ion. 


6.2.3  nintmum  Abmolutjt  ^_rer_ SrjLt«r  1  on 

Givan  th«  probability  donoity  p(«)  of  •  random 
par«m«t»r  a»  th«  optimum  DPEF  •ymtmm  which  mlnlmUmm  thm 
absolutm  mrror  functlon»  l*m«»  thm  optimum  combining  rulm 
and  thm  optimum  mmtimatlon  rulmm  at  thm  local  matlmatora  la 
obtalnmd  by  solving  thm  following  aquations  simul tanmously . 


..(h) 


da  p(a|h) 


da  p( a  I h) 


( 6-26 ) 


au«-(h) 


l.b. 

f  r 

dY^  da( - )  p<a.Y‘|y 

J  J  S3 1 


dY'  da( - )  p(«»Y‘|yi> 

SS  X 


I  “  lf2»*«»fN 


(6-27) 


Proof 


Thm  risk  function  for  thm  absolutm  mrror  crltmrlon  Is 


R-f-  »  E€  ja-a| > 


(6-28) 


For  thm  cost  function  dmflnmd  In  (6-3-b)*  thm  risk  function 
is  givmn  by 


R«t—  -  dh  p(b)  daC|a-*<h)ja  p(a|l 


(6-29) 


First*  »«•  obtsin  th«  aptimufli  combining  rulm 


Optimum  Combining  Rulm 


In  (6-59) «  wm  dmfinm  1(h)  ms  bming  thm  innmr  intmgral 


which  can  bm  writtmn  as 


X(h) 


»  k 

da  CS(h)-aI  p(a|h)  *  da  [a-S(h)]  p(a(h) 


S(h) 


(6-30) 


Again*  wm  aaBumo  that  whilm  dmriving  thm  optimum  combining 


rulm  which  minimizma  R.t>»*  thm  matimation  rulma 


hi  ()^i )  *he(  ys) . and  hr4(yM)  arm  known.  If  a  minimum  mKista 

and  is  intmrior  to  thm  parammtmr  apacm*  wm  obtain  thm 


minimum  by  diffmrantiating  1(h)  with  rmapmct  to  X(h)  and 


amtting  it  mqual  to  zmro.  Thmrmforo* 


X«*..(h) 


XX(h) 


da  p(a|h)  -  da  p(a|h)  >  0 


X....(h) 


(6-31 ) 


whorm  X..i>.(h)  is  thm  optimum  matimatm.  Solving  (6-31)*  wm 


•mm  that*  X«b_(h)  which  minimizma  R.*..*  ia  thm  mmdian  of  thm 


a  poatmriori  probability  dmnaity  of  a  givan  h.*  i.m.* 


55s 


S4 


.-<h) 


da  p(a|h) 


da  p(a|h) 


(6-32) 


..(h) 


Naxti  wa  obtain  tha  aatimatlon  rulaa  at  tha  local 
aatimatora. 


Local  Eatimat lpn_Rul.Bp 


At  this  point*  wa  aasuma  that  all  but  aatimator  i*  hava 
baan  daaignad  and*  that  tha  combining  rula  ia  known.  Wa 
obtain  tha  aatimation  rula  for  tha  i  aatimator  which 
ffiinifflizaa  R.*...  Uaing  (6-28) »  wa  may  rawrita  (6-4)  aa 


R... 


I  “''I 


da  C|a  -  I(lt,lB*...iSN) p  p(a*Y) 


(6-33) 


Uaing  (6-13)*  (6-33)  bacomao 


i-a  1 


I  r  r 

R...  -  dy*  p(yi)  «  dY‘C 
J  J  t 


da  (1  -  a)  p(a*Y^ |y* ) 


da  (a  -  S)  p(a*Y.^  |y^  )3> 


( 6-34 ) 


•  •  •"  •  •  •  •  •  •  •  ' 
-  v  •  ••  ■  ■ 


tpihitr«t  )L*’  i*  givvn  by  (6-17).  L«t 


t 


C  da  (t-a>  p(a»y^|yi> 


da  (a  -  t)  p(a»Y^|yt>]  (6-39: 


Aaauaing  that  a  miniaum  axiata  and  ia  Intarior  to  tha 
paraaatar  apaca*  tha  valua  of  S  which  ainiaizaa 
alao  ainiaizaa  Taking  tha  darivativa  of  I«t..(yk>  with 

raapact  to  Si «  wa  hava 


*m  S 


SI.i..<yi) 


•  <yi)  f  f  ^S  Si 

- -  dY‘C  da( — )p(a,YMyi)  - (l-l)p(a, YMyi ) 

li  J  J  ^Ii  iTSi 


Si  Si 

-  da( — )p(a»Y^|yi)  +  -  (S-S>p(a, YM yi ) > 

SSi  Sit. 


(6-36) 


Satting  tha  darivativa  aqual  to  zaro*  wa  hava 


SS.ti.  r  SS.,1. 

dY‘  da  ( - )p(a»YMyi>  -  dY‘  da( - )  p(a,YMyi) 

Si  1  J  Si 1 


-•  i^„m 


i  *  l»S««aa»N 


(6-37) 


■vi'aAi 

w 


This  procadur*  la  rapaatad  for  all  of  tha  N  aatlaatora.  Tha 
raaulting  N  aquations  ara  aolvad  alaultanaoualy  to  yiald  tha 
optiaua  local  aatiaation  rulaa  which  ainiaiza 


Ovarall  Soluti on 


Tha  ovarall  solution  to  this  problaa  is  obtainad  by 
solving  (6-37)  and  (6-38)  siaultanaously f  which  is  tha 


dasirad  rasult. 


Spac i al  Casa  of  t wp  astiaators 


Q.E.D. 


For  tha  two-astiaator  systam*  tha  aquations  to  bo 


solvad  ara 


r  r  r  r 

dya  da( - )  p(afya|yt)  *  idy*  da( - )  p(a»ya|yi) 

J  J  J  J  Sit 

-a  -m  -m  3uom 

( 6-3B ) 


r  r  r  r 

dyi  da( - )  p(afyi|ya)  »  dy»  da( - )  p(aiyi|ya> 

J  J  <ra.  J  J  •». 

-•  -•  -• 


( 6-39 ) 


S.b.(h) 


da  p(a|2iSa)  da  p(a|5ifSal 


(6-40) 


.b.(h) 


O  a  •  .  >  4’  •  • 

■  ■  •  «  '  .  ^  I  i  ’  ' 


Solving  (6-38) >  (6-39)  and  (6-40)  ylald  tho  doairod  roault. 
Naxtf  H«  study  ths  cass  of  uniform  cost  function. 

6 . S . 4  Minimum  Uniform  Cost  Function 


Wm  considsr  tho  problsm  of  finding  ths  optimum 
mstimation  rulss  at  ths  ostimators  and  ths  optimum  combining 
rulss  which  minimizs  tho  avorago  cost  in  this  caso  for  tho 
DPEF  systom. 

Thoorom  6.3 


For  tho  DPEF  systomi  tho  optimum  combining  rulo  and  tho 
optimum  ostimation  rulos  at  tho  local  ostimators  which 
minifflizo  tho  uniform  coat  function  for  a  givon  p(a)»  aro 
obtainod  by  solving  tho  following  aquations  simultanoously 


S  In  p(a|h) 


a"!..,. 


%  -r 


o 


(6-41 ) 


and » 


Y‘|y»)dY‘ 


- p(a-  -T+S,  YMyi  )dY^ 


i  -  1,2*..., N  (6-42) 


Proof 


Tho  risk  function  in  this  caso  is  givon  by 


1*1 


'1 


dh  p(h)  Cl 


m 

-I 


p<«|b)  da  ] 


(6-43) 


Link-r  — T 


which  ia  aquivalant  to 


*m  T+1 


RtirM^  *  1 


It  i 

dyi  p(yi)  dY‘  da  p(a»Y^|yi) 
t  J 


( 6-44 ) 


-•  -T-^» 


First •  wa  dariva  tha  optimun  combining  rula. 


Opt i mum  Combining  rula 


Wa  aaauma  that  all  aatimators  hava  known  astimation 
rulaa  and  wa  obtain  tha  optimum  combining  rula  ao  aa  to 
minimiza  Rur^i-e.  Tha  risk  function  is 


*  I 


Sunl-r  ♦■T 


dh  p(h)  Cl 


% 


p  (a|h)  da  1 


(6-43) 


Sunt-r  — T 


Wa  also  aaauma  that  a  minimum  axiats  andf  is  intarior  to  tha 
allowabla  ranga  of  a.  Lat 


1(h) 


luril-r^T 


p(a|h)  di 


(6-43) 


Thany  maximizing  Kh)  minimizas  and  this  is  achiavad 


.  ■« 


by  taking  th«  darivativa  of  I(b>  with  raapact  to  and » 


Batting  it  aqual  to  zaro.  This  raaulta  in 


S  p(a|ti> 


(6-46-a) 


fin  p(a|h> 


(6-46-b) 


Having  obtainad  tha  optimum  combining  rula»  naxtf  wo  obtain 


tho  optimum  astimation  rulas  at  tha  oatimatorB  bo  bb  to 


minimiza 


Estimation  Rulas 


Wa  asBuma  that  tha  combining  rula  t(h)  is  known.  Ha 


also  asBuma  that  whila  dariving  tha  astimation  rula 


li«ht<yi)  at  tha  i astimator*  i  >  ltS»...»N»  tha  othar 


astimators  hava  known  astimation  rulas. 


In  this  caso*  can  ba  SKprasBad 


T-*-* 


»  r  r 

dy»  p<yi)  dY‘  da  p(a,Y^|yi 
«  4  4 


)  (6-47) 


-a  -T+* 


T-*-* 


»  r 

;i(yi>  “  dY»  da  p(a»Y*jyi 

I  « 


(6-48) 


-a  -T-^l 


M 


v.VJsl 


V‘-.rN 


m 


.  •  «  •  «  w 

yys 


,r;ij 


Thani  If  a  mlniauM  axiata  and  la  intarior  to  tha  ranga  of  a> 
ffllninizing  Rwim*'  with  raspact  to  ■  hk(yi>  ia  aquivalant 
to  maximizing  I^Cy^).  Taking  tha  darivativa  of  Ii(y»)  with 
raspact  to  ti  and  intarchanging  tha  darivativa  with  raspact 
to  a»  and  tha  intagral  ovar  wa  gat 


tf  li<yi) 


- -  clY‘ - t  da  p(a»Y^|yi 

Si  1  I 


(6-49) 


-T*a 


This  may  ba  writtan  as 


T+i 

s  it(yi)  f  r  tf(T-*-a) 

- ■  dyi  <  da  (0)  + - p(a“T+a,  Y»|yi) 

£  S%.  J  J  as L 

-a  -T+S 


a(-T+a> 


p(a*-T-*-3»  Y‘|y»>> 


( 6-50 ) 


ai»<y.i>  r  as 

- -  dY‘C  —  Cp(a-T-»-S,Y‘ |yi.  )  -  p  ( a— t-^S  ,  Y"  |  y,.  )  3  > 

aSk  J  as  1 


i  -  1,S».. . »N 


(6-5.1  ) 


Satting  tha  right  hand  sida  of  (6-51)  aqual  to  zaro  and 


r««rranging  th«  result t  m«  get 


■  «."  e.^  s 


r--- 

J  Six 


p(«»T-«-«,  Y^jy^)  dY‘ 


I" 

J 


p(«“-T+l*  Y‘jy».)  dY‘ 


i 

•v-.%y 

v-^5 


1  •  lfSp««>fN 


(6-52) 


We  may  repeat  thia  procedure  for  all  N  eetimatora.  Thusp  wo 


obtain  N  equations  of  the  form  (6-52) p  whose  solution  yields 
the  estimation  rules  at  the  local  estimators  which  minimize 


Overall  Solution 


The  overall  solution  to  the  DPEF  problem  with  minimum 
criterion  is  obtained  by  solving  (6-46)  and  (6-52) 


simultaneouslyp  which  yields  the  desired  result. 


Q.E.D. 


S£9C  I  a  1  .Case  ..of  ..Two  Estimators 


Againp  in  the  case  of  two-estimator  DPEF  systemp  the 
equations  to  be  solved  are 


^In  <p(a|h)> 


( 6-53 ) 


a-S(Sppl.) 


I--- 


p(e"T+lp  y«|yi)  dyi 


.  I " 

J  Six 


p(a“-T4-a,  ya|yi)  dyi 


( 6-54 ) 


r-- 

J  Sim 


p(«*T+*.  yi|ya)  dy 


J  Sim 


p(«“-T+li  yi|y«)  dyi 


( 6-53 ) 


6.3  Suboptimum  Solut i pn-„  Linmmr  Comb Ining  Rulm 


In  thm  •Btimatlon  problmm  Btudimd  In  smction  6.S*  thm 
optimum  dmaign  rmquirms  thm  mimultanmoum  molution  of  (N  ■*■  1) 
couplmd  nonlinmar  mquationm.  Thmmm  mqumtions  arm  hard  to 


Bolvo. 


Thmrmforof  it  ia  dmairablm  to  conaidmr  aomo 


auboptimum  aolutiona.  In  thia  aaction*  wo  roatrict  thi 
matimation  combining  rulm  to  bm  a  linmar  onm^  i.o.» 


1(h)  -  Z  bi  hi  (y  , )  C 
i-1 


( 6-56 ) 


whmrm  bi  and  C  arm  conatanta  to  bm  foundt  i  ■  lfSf...iN. 
Thia  combining  rulm  may  bm  aimpllfimd  furthmr  by 
incorporating  bi  in  thm  oatimatm  hi(yi)  itamlff  i.m.« 


t(h)  -  Z  hi <yi)  ♦  C 
i-l 


(6-57) 


Thm  uam  of  linmar  combining  rulma  rmducoa  thm 
computational  difficulty  conaidorably .  In  thm  root  of  thia 
aaction*  wm  prmaont  rmaulta  for  thm  DPEF  problmm  uaing  thm 
throo  coat  critaria  for  thm  linmar  combining  rulm. 


3/2 


"'^OY  RCQ^,  TJSY  chart 

HATrON*!.  eu«EAy  or  ST*M)A«0$-1*«5-  • 


6.3.1  niniinmB  ri««n-SQUT«-Eri 


For  thio  crltorlon*  substituting  (6-97)  in  (6-8)  ths 
iissn  squsrs  srror  bscomss 


fW 


I 


N 

ds  C  a  -(Z  h,(y,)  C)3«  p(a,Y)  (6-98) 

J-1 


Substituting  (6-19)  in  (6-98)*  turn  got 


«  I  dY*p(y*)|  dY^I  da  Ca  -  Z  hi(y3)-  C3*  p(a»Y^|yi) 


(6-99) 


Ws  follOH  ths  sams  procsdurs  as  ussd  in  Ssction  6.S  to 
miniinizs  Rn««  i.s.*  ho  sot  tho  dorivativo  of  tho  innor 
intogral  in  (6-99)  oqual  to  zoro  and  solvo  for  tho 
ostination  rulo*  hk(yi)*  of  ostimator  i*  i  »  1»8»...»N.  Tho 
rosulting  h*(y*)  is 


h*(y*)  -  E  <a|y*>  -  Z  E  t (h,(y, ) ) I y* >  -  C 

j-1 

ifi 

i  -  1*8»...»N  (6-60) 

Noh*  ho  only  nood  to  find  tho  valuo  of  C.  Taking  tho 
dorivativo  of  Rmb  Hith  rospoct  to  C  and  sotting  it  oqual  to 
zoro*  HO  obtain  tho  dosirod  rooult. 


C  -  E  CCa  -  Z  h4(y*)]>  »  Eta>  -  Z  ECh,(yj)> 
j-1  J-1 


(6-61) 


186 


1 


vj 

•r 

‘•3 

'*1 


N«xt«  *t»  prmmmnt  thm  abovm  rMult  for  th»  cam  of  two 
•stlMtors.  Xn  this  cao«»  •quationo  (6-60>  and  (6-61) 

bacoaa 


hi(y;»)  -  ECa|yx>  -  E{(h«(y«) )  -  C 

h.(y«)  «  E{a|y.>  -  E< (h^ (y > ) ) | y«>  -  C 


(6-68) 


(6-63) 


C  •  E<a>  -  E<h»>  -  ECh»> 


Substituting  (6-63)  in  (6-68).  ws  gat 


(6-64) 


hi(yi)-  ECajyt)  -  E<  (ECaj  y«> )  |  y>  >  -i-EC  (EChi  (yi )  |  y«> )  |  yi  > 


(6-69) 


6.3.2  Miniiiiuw  Absoluts  Error  Crttsclan 


Now»  wo  solvs  ths  OPEF  problsm  whsn  a  1 inoar  combining 
rulo  is  usod  at  tho  fusion  cantor  and  tho  absoluto  orror 
critorion  is  usod  for  optimization.  Substituting  (6-97)  in 
(6-8)  and  using  an  oxprossion  similar  to  (6-12) »  wo  may 
rowrito  as 


1 


•A*' 


i  -» 


r  ** 

daCZ 

J  j-1 


f  ** 

fdmCm-<Zh 

J  j-1 


s(x*>^C>J  p(«,Y‘|yi)> 


J-1 


(6-66) 


Wa  usa  tha  aama  procadura  aa  uaad  in  Saction  6.8.  Wa 
minimiza  tha  risk  function  with  raapact  to  hi(yi)  by 
minifflizing  tha  innar  intagral  l^dn  brackat).  Wa  taka  tha 
darivativa  of  with  raapact  to  hi  and  aat  tha  raault  aqual 
to  zaro.  Wa  gat 


r  h,<yj)-*-C 

•  J-1 

dY‘  «[  da  p(a,Y‘|y 


■•■I 


da  p(a»Y^ |yi >  > 


Z  hi{yi)-»-c 

J-1 


(6-67) 


h  1  (  Ya  > 


da  p(««  Y‘1y^) 


hi(  Yk  > 


da  p(a|Y^> 


(6-68) 


Raarranging  (6-67)  and  aubatitutlng  (6-68)  into  tha 
raaulting  aquation*  wa  gat 


hk (Yk ) 

S  I  da  p(a|yk) 


+  2 


N 

(Ya>‘^C 

j*l 

I  dY‘  da  p  (a,Y‘ |Y»> 
-•  hk(Yi> 


(6-69) 


or  aquivalantly ( 


hk (y k ) 


da  p(a I Yk ) 

1 


N 

I  h*(y3)+C 
j-1 

da  P(atY‘ |y»  > 

hk (yk ) 


i/a 

i-l.S>..*N. 

(6-70) 


Now*  wa  obtain  tha  optimuin  valua  of  C.  Wa  asauma  that  all 
aatimatora  hava  alraady  baan  dasignad.  R.b.  may  ba 
rawrittan  aa 

N 

2  hj(y*)-^C 
*m  j-1 

IP  N  r  N 

dY«  daCrh,(y,)+C-alp(a*Y)-*-  daCa-C-Zh  j(Yk  )p(a,Y)> 

-a  -a  ^  N  ^ 

r  h,(Yi )*C 


(6-71) 


Xn  th«  spccittl  cmum  of  tno  •stimatora  th«  combining 


rulm  bmcomms 


Kh)  *  •t'  h«<y*>  C 


(b-79-«) 


Thm  following  amt  of  aquationa  naad  to  ba  aolvad  to  yiald 


tha  daairad  raault 


hx (yi ) 


*m  hi(yi  )'«'hK(y«)-<'C 


da  p<o|y 


>  • 

1 )  ■*•  dy« 

%  % 


da  p(aty*|yi)  ■  1/2 


(b-7a-b> 


h«<ye) 

[  da  p(a{ye) 


ht (y»> 


hi(y»)  hK(ya>-*-C 


'  ‘ 

dyi 
«  < 


da  p(a»yt|ya)  *  1/2 


(6-73-0 


-a  ha<ya) 


*m  *m  hi(yt  )'»-h«(ya)-4’C  h » ( y« (ya> 


Jdy.Jdy. 


da  p(a»yi tym>  * 


*  r  r 

dy*  dy«j 

V  W  ll 


hi  (yi)-i-ha(ya) 


da  p(a»yi*ya)  *  1/2 


(6-73-d> 


6.3.3  ninimum  Uniform  Coat  Function 


In  thla  aactlony  again  wa  uaa  tha  aama  approach  aa  uaad 
In  Subaactlon  6.2.4.  Subatituting  (6-37)  In  (6-32) »  tha 
aquation  daacrlblng  tha  aatlmatlon  rula  hi(yi)  of  tha  1**^ 
aatlmatort  la*l»2f  ...»N»  bacomaa 


M 


dY‘  p(««  T  ♦  I  hj(yj)  ♦  c»  x‘|yfc>> 

J  j-l 


W 

I®*!!:'' 


dY‘  p(«-  - 


T  ♦  E  h,(y*>  C,  5r‘|x^>> 
j-l 


i  *  1 fSt • • • »N 


(6-76) 


W«  Bolva  for  C  by  taking  th«  darivativ*  of  with 
raapact  to  C  and  aatting  tha  raault  aqual  to  zaro.  Than*  wa 
gat 


5SKf 

'■wM' 

M 


dY  p<a*  E  hj  ( yj  )  Ct  Y)  ■  0 

j-l 


(6-77) 


(6-76)  and  (6-77)  daacriba  tha  coaplata  solution  to  thi 
probloffi. 


In  tha  caaa  of  two  aatiaatora  tha  aquationa  ara 


J*  dy»  p(a"T-*-hi>h«-*-C»^»  |y*t)*  J  dy»  p  (a*-T-«‘h  a-*-h«-*‘C»  yt  |  y* ) 


(6-78) 


‘'M 


i 


i 


f 


Wl 


i'} 


a 


)JiC 


<& 

I 


J  d^a  p<«"T-*-h»  ♦ha+Cfy*!  yi  >“  J  dy*  pCa^-T+hi+ha+Ct yajyi ) 


(6-79) 


I  “''‘f 


dya  p(«“h»  (yi  )-*-ha{ya)-*‘C»  y»»  ya)  •  0  (6-80) 


For  illustration  purposssf  ns  prsssnt  a  sispls  sxampls  in 


tha  noxt  asction. 


6.4  Exampls 


In  this  ssction  ns  considsr  ths  systsm  shown  in  Figurs 


6.2.  Two  local  estimators  are  used  along  with  a  fusion 


center  which  employs  a  linear  combining  rule.  It  is  desired 


to  estimate  a  parameter  ”  a  "whose  density  function  is 


p(a)  » 


(2it)‘'"  <r. 


ixp(- - ) 

a«r.* 


(6-81) 


Each  estimator  1  receives  a  single  observation  yi t  i  ■  1»  2» 


corrupted  by  additive  Gaussian  noise  n^p  i  *  1«  2.  Noises 


at  the  sensors  are  assumed  to  be  independent  of  each  other 


as  well  as  independent  of  the  parameter  a.  The  two 


observations  at  the  estimators  and  their  conditional 


■  t*  A**  m  •  . 


^51' 


M 

IWi*' 

Iw’: 


4 


danaitiM  ara 


•  Ha 


(6-BS-«) 


( 6-B2-b ) 


1  (y  »-•)*■ 

p<y»  |a)  - -  <. - > 

<r«  <air)»'“  a  <r„« 


i-1  ,a 


(6-B3) 


Our  goal  is  to  obtain  tha  optimum  local  aatimation  rulaa 
hi(yi)  and  he<ya>  ao  aa  to  minimiza  Rm*  whan  a  linaar 
combining  rula  ia  uaad  at  tha  fuaion  cantar. 


Whan  tha  combining  rula  ia  known  to  ba  linaar  •  1  ia 


1  -  htiyi)  h«ty«)  +  C 


( 6-B4 ) 


hi(yi)  and  haCya)  ara  obtainad  by  solving  tha  following  aat 
of  aquationa 


h»(yi>  -  ECa|y,l  -  EEha(ya>|y,3  -  C  (6-B5-a} 
ha(ya)  -  ECajyal  -  EChi<y,)jya3  -  C  (6-BS-b) 
C  -  E<a)  -  EChi(yt)3  -  EChaiya)!  (4i-B5-c) 


Subatitutlng  (6-B9-a)  into  <6-83~b>F  wa  gat 


hi(y»>  -  ECajyil  ~  ECE(a|ya> |yi 1  -  ECECh , ( y » ) | yal | y i 3 

(6-86) 


For  this  sxsmpls  ths  conditional  dsnsity  function  of  a  givsn 
yk»  i  «  If  5»  is  givsn  by 


1 


p<«|yi> 


(aii)ir,itr„  (y^-a)"  a*^ 

{  -  }  ,5.,^  C-  (l/a)t - + - 3> 

p  <  y .  )  ff  •“ 


iwlfS  (6-87) 


or 


p(a|yi)  *  ki(yi)  sxpf-(l/S) - Ca~ - yf3*^> 

ffr>“ 

i"l,2  (6-88) 

which  is  ths  probability  csnslty  function  of  a  Gaussian 
random  variabls.  Ths  msan  and  ths  variancs  for  ths 
conditional  distribution  ars  CHOI 

msan  - -  <y.)  =  m...  ,  %  (6-89) 

variancs  - - -  (6-90) 

Sines  yi  and  y»»  ara  jolntlv  )3a«iw<fian  i  avKinfr*  -sri^blssf  ths 
msan  of  yi f  E(y«)f  and  ths  cavrrianrw  of  y  ard  /»  and  ths 
variancs  of  y».  ars  givsn  by 

E(yi)»  E(a)  -*  E'n,)  (6-91) 

E(yiyai)  »  E(a')  w.*'’  (6-92) 


V 

v* 


ht (yx) 


<r-“+a„' 


O'.®  O'.® 

-  ECC -  y.]|yi>+ECCE(hx(yi) |y.3|yt> 


<r 


( 6-97 ) 


which  may  ba  raarrangad  aa 


<r«®  (r„“ 

hi<yi)- - yx  ECE(hx(yx}}  |y«3|yx>  (6-98) 

(a«=  + 


In  ordar  to  attampt  a  aolution  to  this  problaa*  wa  maka  a 
aimplifying  aaaufflption  that  hx(yx>  ia  a  linaar  combination 
of  yx f  namaly  hx(yx)  *  kx  yx.  Thia  aaaumption  ia  appaaling 
bacauaa  tha  cantralizad  aolution  ia  of  tha  aama  form.  Thua» 
wa  only  naad  to  find  tha  coafficiant  of  yx  in  tha  linaar 
function. 


<r.“  <r„' 


kx  yi 


(<r«“  Cr,®)' 


'  •;‘v' 

-=  V  ; 


I  dy.  p(y«|yx)  |  kxyx  p(yx|yB>  dyx 


(6-99) 


which  bacomaa 


<r«“  <r«“  C-* 

kxyx- - y  X  ■*■  kx  ( - )“  yx 

(«■•“  ♦o-,,®)  <r«®  Vr.® 


Eliminating  yx  and  aolving  for  k x  »  wa  gat 


(6-100) 


kx  -  1/5 


a.®  ♦  (<rr,®/a) 


(6-101 ) 


SlMllar  •xprvBBion  can  b*  obtained  for  k*.  Thani 


C  -  ECa  -  hi(yi)  -  h«(y«)3  -  0 


and  tho  optimun  oatimata  is 


l(yi»ya)  -  (1/a) - (yi  *  y«> 

<r.«  ♦  <<r„*/a) 


<6-10a) 


(6-103) 


which  is  tha  sama  valua  as  obtainad  for  tha  cantralizad 

casa. 


Naxt*  wa  obtain  tha  astimation  rulas  for  tho  DPEF 


problom  ao  aa  to  fliinifliizo 


Hinimuw  Uniform  Error  Function 


In  this  caaa*  tha  donaity  functions  p(yi»ya»a)»  and 
j  ^  i*  i  ■  1>  a  ara  givan  by 

1  a.“C(y»-a)®+(y«-a)*3+a**<r„“ 

p(yt*ya»a)  - - axpC - > 

(aw)=“''«<r-<r„“  a(a„  a.)® 

(6-104) 


Ca  -  (yi+y») - 3® 

<r„®  +  aa.® 

p(yA»«|y»)  ■  k(yi)axpt  -  -  > 

a„®  a.® 

ca - 3 

a„®  ♦aa.® 


(6-103) 


frV’?:.'. 


Th«n* 


i<_ ’•«- 


■  ft**  f**.0*' 


VII.  SufflfliAry  and  Suggestions  for  Future  Mork 


7.1  Summary 


In  this  report#  we  have  considered  the  problems  of 
hypothesis  testing  and  parameter  estimation  when  multiple 
sensors  are  used  and  a  global  decision  (or  estimate)  is 
desired.  For  the  hypothesis  testing  problem*  we  have 
considered  Neyman-Pearson  detection*  Bayesian  detection  and 


minimum  equivocation  detection. 


In  all  cases*  local 


decisiuns  are  fed  to  a  data  fusion  center  where  a  global 
decision  is  obtained.  When  the  fusion  rule  is  given*  the 
decision  rules  at  the  individual  detectors  were  derived. 
When  the  decision  rules  at  the  individual  detectors  are 
known*  we  derived  the  optimum  fusion  rule.  We  also  derived 
the  overall  solution  to  the  problem*  i.e.*  obtain  both  the 
optimum  fusion  rule  and  the  optimum  decision  rules  at  the 
detectors  simultaneously.  We  obtained  the  results  for  the 
general  problem  of  distributed  hypothesis  testing  with  data 
fusion.  With  an  appropriate  choice  of  the  fusion  rule  and 
the  cost  assignment*  the  DD  problem  becomes  a  special  case 
of  our  problem.  For  the  Bayesian  formulation*  we  have 
considered  the  case  of  identical  detectors  with  independent 
observations  and  obtained  the  value  of  K  in  the  "K  out  of  N" 
fusion  rule.  Distributed  postdetection  integration  has 


m 


••S' 

.  ft**> 


m 


m 


«:?•.  k>rr- 


.S'NjV 

K*  K.  ."s. 


□I 
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J'a' 


mm 


also  bsan  considarad  whara  two  schamaa  wara  proposad.  Tha 


corrasponding  optifflum  rulas  hava  baan  obtalnad. 

Ma  hava  also  considarad  tha  distributad  Bayasian 
paramatar  astimation  problaflif  whan  local  astimators  transmit 
thair  astimatas  to  a  combinar  whara  a  global  astimata  is 
obtained.  Optimum  astimation  rulas  at  tha  local  astimators 
and  optimum  combining  rulas  hava  baan  darivad  for  thraa 
diffarant  cost  critara. 


In  all  of  tha  above  cases*  tha  aquations  that  spacify 
tha  solution  ara  couplad  and  highly  nonlinaar  and  ara 
tharafora  hard  to  solva.  Tha  laval  of  computational 
difficulty  incraasas  rapidly  with  tha  number  of  decision 
makers  (or  estimators)*  especially  for  tha  minimum 
equivocation  and  paramatar  astimation  problems. 


7 .  S  Suggas  t  i  o.ns. . f  q.r. .  Fu  t  uca,  _Wor  k 


One  area  of  research  that  should  be  pursued  is  to  find 
efficient  ways  to  solva  tha  sat  of  highly  nonlinaar  couplad 
aquations  that  ara  characteristic  of  tha  decentralized 
detection  and  estimation  problems. 


Other  fertile  areas  will  be  to  solva  signal  detection 
and  astimation  problems  in  an  uncertain  environment  in  a 
distributad  framework.  Knowledge  based  approaches  to 
multisensor  integration  and  data  fusion  can  also  be 
considarad. 
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